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Section I • 
INTRODUCTION * 



Background 

ComDuter technolos^y has. evolved with ah almost* 
incomnrehens'ible raoidity over the past two decades., 
Applicatiops of this technolo^q:v have tihancred from purely 
numerical oroeirams to solution of sophisticated scientific^ 
Droblems to manipulation and processins; of. natural lan{;ua?e. 
The latter application has resulted in a pian-comDuter 
symbiosis where the computer system becomes an extension of 
man's intellectual processes. In a now classic paper,. • 
J.C.R. Licklider (1968b) outlined the total system with man 
and computer as intet^ral components. Parallel to the 
.develoQment of computter capability over the past decade has 
been the development of a system dgsj-gned to take maximum 
advantage of the computer ' s' power to- store, structure and 
retrieve textual' .in formation in a 'wav congruent with the 
characl^er istics of an individual. . 

AporoDriately , the name given to this system was the 
Augmented Human Intellect Svstem, developed under the ' 
leadership of Dr • Douerlas Efigelbart of the Stanford 
Research Inst itute . Orie:inally, the purpose was ta ^ . 

increase the capability of man to approach a complex 
Droblem situation, to gain comprehension to suit his ^ 
particular needs, and to derive so]jutions to problems." 

'(Lindc:ren, 1971) This intention to provide an extension to 
man's intellect by utilizing a set of powerful computer 
basedvtbols ,was gradually broa^dened to provide an extension 
to a g^up's cap^=ibility and to that of an organizational 
structure and then to c:eograt)h ically separated groups and 
orG:anizations . 

• ■% . , 

The act of auj:menting a number of individuals with the 
same^system oernitted a new avenue for interaction: that of 

;c(vifciuter mediated fcommunicat ion . The study of communication 
in'such'a novel situation is the goal of this investigation. 
The background will • includ^e a description of the System as 

" it * certains to human (Communication .^Detailed descriotions 
of^he hardware and the software (/'software" refers to any^ 
f unot/ien ing computer program , as opposed to the machinery it 
runs on) may be obtained in the referenced sources.' The 
origin of* the ^problem Hill be further- explained^by^ the ^ 
feview of literature. / 

: y / ' ' ^ , . . ^ . ; 
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System bescription ^ . ' ' . • ■ ' 

r - . ^ ' . . . % • ■■ • 

AHI T-s desip;ned to take Tull advantage "of the 

s'tate-of-the-art in .computer te,chrfoloe:v . It is ^n 6n-line^; 

real time, ti^e-sharing system with a, full duplex 

(simultaneous transmission^ahd recepticJn) terminal-to-system 

link.. The nesult is a hifi^hlV ^interactive inter face ' between 

the computer*' and the us-er . Indeed , there is little 

difference between this, man-computer ^ in ter face and a . 

man-tp-m^n interface. ^ < . 

T^e ' lane;uage medium fo^ th is in terac tion is of two 
basic kinjds: the subse,t of. .naturaj Enp;lish that has been 

'selected to have^ specific meaninc: to the cbmputen program 
(command langua?:e>, and natural language text which is' 
meaninf^/ful': to oeople. >The -^'command^danguage" ^or kHT^ is. 
highly develooed with^ a r icrcrrous syntax;, that , permits maximum 
flexibilty for the user. :*Jt includes' many * shortbuts. that 
permit a user to^ commutiicate wit-h the system^ about as f^ist. • 
as he^c.an type , 'manipulate the interface transducers, and 
.think. ^ * - t " , ,^ , • 

■ ' <- - • ' ' ' . . , ' 

When an 'individlual user establ ishes .a connection with 
the main computer he/is able to create, store, organ ize and 
manipulate-^written textual material. Entering written text 

.•into computer stora-ge is/s'lmiiar to an automatic typewriter 
ooeration. Once text of^any kind is* entered, it .is 
available' for a 'wh-ole • host o f operations,- including a 
powerful text editing capability. ' / ^ 

The manipulation of symbols, is grea.tly aidedf by a 
hierarchiQal structure. -.Every user identified unit of text\ 
is automat icallv numbered and assigned a user determined 
level in the hierarchy.- This establ ish>es a relationship to 
the t^xt in general. The structxrer facilitates addressing 
and/vtewine: the text by units of the hierarchy such as ^ 
st;^tements and branches. ' » , * ^ 

- . The " Viewsystem'^ oermits the viewing >of text in many 
different ways' analogous to ^'Windows" into the Stored 
i|Tf ormation . Eor ex%mp.le, the "viewspe'cs" facilitate > 
viewing specified revels in'yhe hie'ra-rchy thus controlling 
the amount of d'etail the\jjse/ ; wants displayed or printed . 

The tree structure applies to files which are analogous 
to documents or books and are the storage unit for the 
executiv'§ software. Thesfe provide a means of further 
structuring text. Files can be com±>ined, in part or in 
whole, with any other , file , ^ and the ;user can "jump" betw 

. ■ ■ . * > , • .■»• 
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varidps files^..- Part of th& AHI capg(b il ity, i^s 'similar to. a 
library where a oerspn merely types his request and all-^^^ 
books are * Dresen ted to him* for instant composition into a' 
report or other^ new textual .entity. Not 6nly are the fij.'es 
in his own library alvailable t^q him, but .all system' users' 
fiies are available unless otheKwise specified. • 

The manipulation. of textual mV^erial through the wse of 
the addressing and viewsyste^ms is a Y^'l^^i^^lV^ small' part of 
the capabilities o/ffered.. There has/ been some question 
about the additional power of AHI r/lative to the nufnerous 
operational t6xt 'editing so ftwa re "system s . A survey by van 
Dam and "^ndries answers this aues^^ion., • V 

/ • 

embodies much more j/nan just a text ed itor the ir^ 
aim J/fe to Drovide a new Ji^^ay of thinking; * and working by;^ 

izlne- the Dower of xhe computer in"" all aspects of 
one's^ work. (van Daj^ 1971 r 110) 





Accordincr to Enp^erl bart ( 1 973) , the additional. , , 
capabilities includes: . communication among teams wit'h joint 
and/^r vsimult ane^Kls ^preparation of text: a ''collaborative 
dialogue"; sending docum^ents, correspondence j and 
coordinating work: "documentation product ion and^ control'" ; , 
and a ^1 ibrary . system for the' storage and retrieval -pf . • 
relevant llte^-ature, etc.: a "r^searcfci intelligence.", 

6ollaborat ij^e dialcjgue: There are computer aids for * 
the composition of messages and for ^^ir subsequent 
reviewing, cross-referencing, modification, transmission, ' 
storage, indexing, and /full-text retrieJical. A *'me>sage" may 
be on'e word in length, /or a hundred, printed pae-es. In any 
message there may , be formalized citations pointing to - ; 
specific oas-sageS in orior messages, so that a group' of 
related messages • becoiijes a network of reco^rded-di^aloNgue 
contributions.* Ther^ is also: automatic delivery of\ 
messages; full' cataloging and indexing; on-line ,\ 
accessibility- both to message notification and to the full 
text* of all meaieages ; and ooen-ended storage of the dialogue 
records. These services enable a community of people who 
are distributed in soace and time l^o maintain recorded, 
collaborative dialogue. . , 

\ ^ . ' . J ^ \ ' , 

- Do.cument , development , oroduotion, and co'ntrol: There 
is a rich set of" 'computer aids for tifte comoosition, study, 
and modification "of dpcument drafts, Vand for au/tomatica;j.ly 
generating high-auallty ph©t<5comppsition output, with 
iflexible contro'ls for fc5nt-designation .and formatting, to 
enable the production of publication-grade ha/rdcopy 
(printing masters; or microform masters) 1* -There are 

• . • • ^ /■•.■■ • ■ ■ 
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ex ternaLity 
cl ippin^iS ,/ 
( therefore 
maintain a^ 



'Rpocesses for collaboration between . sevferal writers , and 
With an editor, in .the process* of evolving a final draft . 
/There are also aids for> thW people who must control chan^ges , 
pew-version distributions , etc . , and* provide^ the . indexing to 
complex documents ''or sets of 'documents . ' / *. * • 

earcja^ intelliccerice : * The provisions within^ the 
("^Dialoe^UeV^Dport System for catal^oc; incc and indexing 
-internally^nerated items also support the 'manac;ement of 

ted items 7- bihl ioGiraphy , contact reports , 
noi>es,, ,etc . With the^e central^ly supplied 
uniformly available) services, a community can 
dynamic ^nd highlit useful, " intell iG:enee" data 
base to help it keep up to date oh external happen in*RS . that 

artlcularly affect , Compute>-r;enerat6d indexes or \ 

on-line, retrieval c^n ''facilitate access . Gitat ions of / 
external iter/s f rcrfniisithin th'e internally-j^enerated dialo^ue^ 
^ase -- in the form ofs^notatl.ons , miscellaneous 
commentary, or support iv&vpe ferences offer v ' _ 

computer-sensible interllnK*tt«^— €kf the external information^ 
with the internal , and 'consi^derably facilitate brbwsin?;, 
retrieval, back^-citation searching, etc. . (Ehgelbart^, 1973) 

- The concept is that of a system which perm^its* the 
man.ipulatiorj of Ene:lish. la(nsuaq;e information utilizing the 
full extent of compUt4h^ tecln^nology -To be augmented is to 
have a Dower f ul set/ of tool3 residinc; in a state-of-the-art 
computer systeWthat are usfe^d in every aspect of knowledge 
work*, i.e. activity .that involves indiv4dual and joint ^ ' • 
oreoaration of messages, ddoc'umentat ion , etc., and sharing 
the results with communities of knowledge ^workers . 
(Enec^elbart, et al.., 1967) /C 




Statefli^e^t of the Problem 
. ^ ' ; : . / ^ \ , 

What effect does a computer system designed ^to- augment 
human Intell'fect • iiave on the individual, G:roups, a^'nd the 
oro:anization^,' particularly commurticlatibn ^within groups and 
an q^p^nizat ion? ; /j^ 



Re 



w of the Literature 



This "question -has not been dealt with to date, 
orimarilv because there are no other systems designed to 
fully augment fiuman intellect.^ . In the case of this system^^ 
the effort of the past ten years has been used to develop 
the system, not to' directly consider its effects. ^. 



Bair: AKW Evaluation 



Page <4 



12 



ERIC 



r ' 



.Elsewhere, there has been a threat deal of work in 
natural lanfe^ua^e* Enc^lish (higher order) applications of 
comDUters , including? in formation retrieval systems, question 
answering or fact retriev.al systems (which is an application 
of artificial in tell icrenc^ svstems), text editinr? systems, 
and on-line conference systems. Spme -considera t ion ^o f the 
effects of these/ kinds of systems as well as the hardware 
devices they employ has be^n invest legated . 

V Historfcal/ly , the 1 imitations ;o f investigations Stem 
frc^TTi- an empha-sAs on the oerformance of the computer software 
. and. hardware /.r/esu,ltinf^ in a nej^lect of the effect of 

Particular sist'ems ^on the' users. In'addition, none^f these 
systems puroo^ts tc\ have any ccreat effect, but rj^er is a 
tool .for a sde^ific calculation or routine. ' R^^ntly, some 
broader applications have been considered anjd^ome of the 
effects of c#fnputer utilization on people J^ve been 
in vest ifiT^ted t 

.Information storage ancf* ret rley^arl systems are reviewed 
first because they repf esen.t Ihe Ijsrast relevant problem 
area. There are thousands of the^e systems as indicated by 
y the Annual. Review 'of Informatioid Science and Technology 

/ ^ (Mollteiomerv, 1969). Most are/basically automated libraries, 

J and are represented by majoi/^ projects such as Project MAp^t 

, .MIT which, included experiments with the ^oal of nlacirv^an 
- ; ■ entire community '•on-line" with shared information resourc^es 
^ " (Rees, 19690. One -problem plae^uiric; such an undertaking; is a 
- lack of computer reliability, as illustrated by the SUPARS 
at Syracuse Universitv where durirj^r a two'year period, th< 
svsten) was available .to the university population for a 
-total of ab.out one month (Atherton, 1971). 

Such computer orob'Iems -^are relatively minor^ comnared to 
. ■ t^he challenge of ..representing:, the* information , writt^ bv 

diverse multitudes of authors , such thslt it mav be retrieveVi 
^ ; hv a user unfamiliar with the data base-. As J. R. Sharp 
^ ' states , ' • . ^ ^ o 

There seems to. be little point in extending machine 
; "Cficil lties which are alreasdy available^' to us whilst we 

. ' , , ; ai^e still comparati\t^ely powerless to convert the ideas 
existJLn^ in human brains into lant^uat^e which meets all 
■ . our needs whether it be used* inside or outside a " 
machine (Share, 196^). ' . • 

. . * ' > ^ ■ f . 

^ . ^ Efforts to convert Idfeas^' into a langua^^e which epuld be 
* .used to retrieve the ideas or^ document surrogates area* 

• extejisive and' represent the maj6r concern in the area of 
inJCormatioFi retrieval. Active in the field is Noah " Prywes 
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(19'67) who enunerates the oroblerns under the rubric, 
"qlassl f icat ion methods." The basic problem is one of 
indexinf^, which is usually a matter of human judc^ement. He 
su^^ests • that the 'indexers receive intense train in^^^ and the 
aid of a computer in the- process of content analvsik^ The 
question of how mucfWof the task should be done by the 
^✓computer or by the mafv is touched upon^ and he notes t^e 
SMART System developed by Salton, which relies heavily'.upon 
the comj^uter. The evaluation of these systems indicate"^'- 
what is of concern, namely the relevance of the citationil^^ 
retrieved '( measured in terms of "j^ecision" and "recall" )\x 

HonocTf^neitv of the data base aids jfn provid inpc ' 
meaninRiful relevance , ^ and thus there are relatively lari^e 
systems in operation such as LITE (a lepral system ), MEDLARS 
(riedical), CHEM ABSTRACTS ,/ CIRG^ ( a military ^telli(?ence ^ 
svstem), whioh bear out this' fact. Ma'ior companies have 
been involved with ooerat ioj«al systems ; however , IBM and 
others are still concerned With the same issues as those 
listed by- Becker and Hayes in 1963. * Sophisticated attempts 
to deal with t^e issues concern Inc? the^representa tion of a 
data base to a specific need are represented by" Fairthorne ^ 
(1<^67), Borko (1966), and Good (196?) who use approachers 
ran^rintr from "notification theorv'^ to decision theorv with 
some t^ood analyses of the in f or;tnatiorr^law in between, « 
These efforts are concerned mainly withXthe 
effectiveness-efficiency of the sS^tem,^ 
recognized by some invest is^ators , 



a limited view as 



A more DrofJitable view is taken by Goodman ( 1968). 
"User In f orm,a^!^ioili Needs..." are his concern to the point 
where he $J^ls /nly with the flow of information amon^ 
personnel. It is .difficult to <^eneralize from^ this kind of 
study. User needs are somethintT that each orctanization 
should assess where It'is important to have technical 
information distributed. The combination of software 
evaluation and user studies has become the more meaningful 
wav to look at the nroblem. A gr^eat deal of work was done 
bv .Alan Ree.s (19^9) to improve e>^aluation by examinirli? the 
subjective respoipses' of users of retrieval systems, i.e. 
relevance. This concept, when added to measures of 
precision and recall, reflects upon the k^rfral problem in, 
this us.e (or any use for! that matter)- of computers, that of 
human behavior, ^ochen (1964) of IBM emphasized adaptation 
to use throucch man-machine interaction, and Paisley and 
Parker V 1965) modelled the process as a receiVer^ con trolled 
commun ioat ion svstem. Thevstated what is perhaps most 
relevant to this paper from this area. To paraphrase, the 
imnortant/ thine; is user sat isfacti^^n wh\l/ch is* a behavioral 
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criterion rather than a structured one, where the behavior 
resDonse orovides the c^uides to ff^roblem soTution, 

Behavior related res^arch-^ although recognized as of 
key importance, has not faired well historically.. In 1966, 
Marks bluntly stated that there is not much, what there is, 
is of poor Quality, and little is known about people* in 
Information storafce and * retrieval systems. This situation 
has not been reversed. Hovtev^r, knowledcce about human 
behavior has been utilized as a source of ideas aqd ' 
approaches to the oroblem of Indexing?, ?ivinc^ rise to *a 
^ e_oa rate area of endeavor called semantic data processinj^. 

Researchers in the area of semantic ' data DroceSsinc? are 
orimarily .concerned with the analysis of lanf^ua^e to 
understand and' then aooly the mechanisms by which meaning is 
reoresented. The <?pal for aoolication of this work is 
Dotnted out^fty Bbbrow (/I967). It, is to enable the comouter 
to "understand" natural Enc^l i31l\ This wili permit access to 
a data b'avSe usin^ natural English wifc+i results eventually 
comparable to human search and retrieval , ' Semantic memories 
such as th/r^'^Tra develooed by Ouillian (I966) model the human 
me'^ory usdnct so^^hist icated mathematical and linguistic 
teohnioues.. Work in this area vert^es on what is referred to 
as ar^ificia-r in tell iprence , and in essence is the practical 
application of th.at field. When data bases can be accessed 
on the basis of semantic content, the user is not limited to 
merely retrieving document surrogates as in a library 
funot-ion, but can bee^in to ask Questions of the 'computer , 

Quest ion-answerins^ systems comprise,^ 'different arTea of 
computer technoloc^y. Although it is considered aoDl ieat ibn3 
orient.ed, it will be some time before ooerational sbrv^ces 
are a reality, (cf. Sass and Wilkinson, 1965) Some 
systems, such as that developed by Qssor io • ( 1 96&^ , have the 
fi^reat oromise of ^actually rendering large. bodies of 
!knowlede:e accessible, but are a long dally -use. 

(tventually, as Borden (I967) predicts, have a system 

, that will be able to structure, classify, aftd generate- 
theories, oredictions and constrnjcts fflom a body of truLy 
representative knowleds:e. In this , 1 ite^'at^re-^'-'tfre ' errp^^si 
is on""creating an artificial intelligence^o serve wh&Veveis 
ends man sees fit, including understanding himself.^ 

The relevance of the foregoing areas of information 
storacte and retrieval apd Quest ion-answerinft systems is 
primarily historical. Studies of the effect of these 
systems have been limited to the flow of and utilization of 
technical "information . The arguments and trends in the 
literature serve as importan t evidence for a change in 
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emphasis- to the human in the*system rather than the 
hardware-software per^formarrce . 

A malor Jactor influencincr the effect of computer 
systems is the de<^ree to which the software actively 
orocesses and transforms information. Fact retrieval 
systems are^more Da9sive than artificial in tell isrence ^ 
systems; information stora(?e and retrieval systems are more* 
oassive than fact retrieval' systems; and ' tex t-ed it in<; 
systems are probably the most 'passive o*f all. There is no 
computation or transformation, only direct manipulation of 
textual *in forma t ion in response to' user commands. 

Tex t -edit In PT software is the. most similar to intellect 
auccnentat ion software to be described in the literature. It 
Is desij^ned to be jjsed by an individual in a manner similaf? 
to an automatic t»VDewr iter ' or as an aid to profl^rammins? (e.g. 
the EMILY systerj) (van Dam, 1971"). Once the typewritten 
in fotS(Tat ion is entqred it eaji be changed for correcting 
Durooses or rearrangerfien t an<il composition purposes. ., The' 
typical text editing software -package , such as that ' , 
available under the GECOS Time Sharing System, (Bair,' 1971) 
enables a user to or^pare, edit, and store infortnation that 
could conceivably be several hundred cages in I'ength. 
^Retrieval from storacre for future use, recomposit ion , pr \ 
'inclusion in another work, is done simply by naming the" 
"file". The only retrieval assistance is a^ list of the 
files belonping„to one user. Although ed iters and their 
companion printout subsystems are in wide uae , there ^are two 
sicrnificant orohlems. The first is a m'atter of computer 
reliabity, usually resultant from, the use of- the computer 
for a larcre number of other prop^rams simultaneously 
( tinje-shar'inc^ ) . - The second re^s^lts' from, the man-aomputer 
interface, an-d the command langoa^oce. ^ - 

Conoute/ reliability is a problem that is receiving a 
(^reat deal o'f attention from computer technologists in 
n-eneral. While the. problems of down-time and errors are 
gradually bein«? solved, it is important to* ncjte the effect 
on users, eso^ecially non-programmers. lrt[ith text editors^and 
AHI, it is much more likely that the user will be a 
non-procrrammer and have had little . exoerience and/or" 
training in computer operation'. " Increasing problems result 
in increasing frustration for* the ulser with all the 
behavioral manifestations to the* point at which the user 
becomes a non-user. Th,is oroblem is more aeute with, 
non-programminq personnel who do not understand the causes 
and do not have alternatives when the system ceases to dxO 
the job they need to^iav^yd^ne . (Bair, 1971) ' ' 
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Aside from this problem, there is little fr\ the 
literature dealing; with individuals or i^^re^tes of Users 
of text editors. Van Dam's (^971) survey of .on-lin^ text • 
editors provides the description necessary for a comparison 
'of text 'editinc: and AHI which should be dor/e to clarify the 
differences. Such a comparison has been done, in response 
to the skeptics' Question, which illustrates that AHI is 
somethincr other'than a fancy text-ed ito^ ( Bair , 1971). The 
man-computer communication problem ass^iated with editors 
is tantamount to the same problem w^tfi all on-line 
interactive computer usage. ' 

The .arqa of man-computer communication embodies a ^reat 
deal of literature in three major areas: human factors, 
software design, and user behavior, which respectively 
emphasize eauioment design , Droj^rafnmincr ,. and human . ^ 
information processint?. The vast (Quantity of. literature 
dealinct with this area per se has been' reviewed^ in the 
Annual Review of Information Science & Technology by Davis / 
. ( 1966), Mills ( 1967), et al. throufrh 1970. Mills and 
PaisJ.ey and Parker \{^1963) are among those researchers who 
view man and comDuter*N<2^ommunicat ine as a single system , with 
the man and the computer ^ sub-systems. The systems 
.approach has led to modeling and analysis of the process, 
cf . 'Grl^netti , et al . , (IbT-D and a view of the system as 
analogous to a human communication dy.ad (Bair^1971). 

The system model has not" received as much attention as 
the s^ubsystems which corresoond to the thre^ areas of 
invest i<Tation mentioned above. There is an extensive but • 
diverse body of research projects and findings in the area ; 
of huma^n factors engineering, as Mayer points out O970).» 
This area is primarily concerned with the desiorn oT^. 
interface equioment (i.e. terminals) to ootimfze the user's 
sensorv motor oerformance . Consequently, this aspect of the 

' communication system deo^nds uoon engineering design that is 
c'orJ^lstentv with xthe f ind inccs and the state-qTf -the -art in 
Jpirardware (few, 1^65). Engelbart and his system designers 

^ave f^iven a frreat 6^al of attention to this aspect of AHI. 
In'fact,^ sor*\e hardware advapces were made in building the 
interface eqyUiDment (e.g,^ the mause and the binary key'set) 
( Enp^elbart , 19j67) . ' ' ' 

Software design is becoming more a prob^^ -of 
man.-computer communication than increasing the , computer ' 3 
caoabllity to provide problem calculations , such as a soace.- 
trajectory. Licklider (1968b) has lont^ argued for efforts 
to achieve a man-machine "symbiosis" deperidjent upon a 
program tha^^^^is compatible with^human functioning. 
Carbonell ( 1969) reoresents those who have-^ us^d a 

Bairf AKW Evaluation ' Page 9 



i 



ERIC 



mathematical modelincr approach to deal with basic issues 
such as task allocation between man and computer. Other 
issues are a- matter of- cpncerh to the more user oriented 
re'searchers • For exaniple, the essential difference between 
man and computer is the computer's requirement for precision 
and perfection as ooposed to man's error proneness and 
capability to -deal with abstract ions and ambiguities. .This 
difference , can be dealt with throu.c:h software desipjn. 

Ccmsideration of the differences between man and 
computer have led to a focus 6n the user as a component of 
the system. Ufta; (196'7) Is amonc; those writers that 
consii^er the behavior br psycholoj?y of the user In addition 
to human factors and confiputer characteristics. An ^ 
examination of man in. this context requires that one must 
draw upon the vast literature in psychology, especially 
experimental, which larc^ely treats him as an information 
processor . , . ' ^ . ^ 

Psychologists' such as Pew, Melton, Fitt s , ^ Hunt Posner , 
and Biederman', for example, have done conc^^ptual and^', ^ * 

laboratory ' work thati%can be drawn upon to delineate the 
human information p.i^acessinc; • tha t occurs in a man-computer, ^ 
system.. A -taxonomy^ of human functional tasks has been 
develooed from. this Work that permits Quantitative - . 

statements about the human's performance in the^system and • \ 
also provides , a framework from which predictions involvinc^ ^ ^ V 
processing time and efficiency can be made. Thi^*, of . ^ 
course, can be valuable to 'desic:ners who are trying to . ^ 
optimize nan-comP^ter communication ( Bair*, . 1971). 

• The ^rea of man-computer communication does not at f * 

oresent deal with the effects on e:roups of Dsers, nor -l 
there 4nv investigation of the effects of intellect 7 
auo;mennat ion software (cf. Computer Aun^mentat 4on oC* Human ' * 
Reasonitncr, where Sass and Wilkinson ( 1965) ^cite a number, of ; 
. efforts! in this a'rea^ such as heuristics, libraries, .and ^ 
. Quest ioTp-answerine: svstems, but do not touch upcn the 
^ effects of a svstem,* such as AHI) . As -has been- pointed o;ut , / 
text editors' are similar to AHI, c^reat in num.bers, bQt \ j , 

apoarently not very interestino^v in terms of effects.^ The ; / •} 
' psycholop;ical effects of computers in creneral ofi man 'are 
hein^ sti^dled, and the continuinc^ work In the laboratory 
will shed more li^ht on humart information processint^. 
' However, reviewing? Hlis literature does ndt tell us anything,, 
about the impact of t)le un ique technolocry that AHI offers., , * 
especially on^the communication amonc^ users. ^\ . > ^ 

■4- 4' * ' . ' ' ■ 

Receatly there h?ave been very interesting: efforts In^ ^ • l 
another area, that of "on-line conferencing." Jn its 

, ■ / ;. 

■ ■■■ ■ ■ . ' ■ . - (•; '7 . ' . 
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simDlest form,, this is the use of an^ on-line comouter in a 
manner analoc^ous to ^a telephone .for handling; messacces . 
between remotely locatefl conferees. In its more complex 
implementation , it is represented by the DELPHI system, 
which is a soeclfic kind of conf.erencinPC . Accordinc; 'to 
Turoff (1971), DELPHI is the use of anonymous responses to 
Questionnaires and other statements of problems, where these 
responses «re then compiled and Ted hack to the respoTidants, 
\ho then respond to this feedback , and so on. He recommends 
t>h^ automation of the orocess and forecasts a "collec'tive 
in^tell ip^ence" from sucfi uses of computes ( Tu^^o ff , 1971, 
32\). . ^ ^ 

\Hall (1971) describes the details of DELPHI automated 
con'fer^ncin??^ which he terTns-"a specific type of decision 
makinf? system" . The computer serves as a data col^^ftion 
and rout icr^ device which enables a cteoc^raoh icallA^^^1^Kfin 
erpouD of Experts on some subject to conduct reryotely those 
discussions and re f erendums that miccht ^occur at a 
conventional face-to-face conference, ^e-meehanias of the 
conference are handled by the computer.^ 

On-line con ferenc inj?; "is one of the caoabilities oT.the 
AHI systeni, and the system could easily be adapted for 
DELPHI- Thus, the literature in this area is hicjhly 
relevant^. Consideration of automated conferencing usually 
•entails th^ i-^nplications of usincr computers mediate 
interpersonal communication in*c:eneral. Turoff ^croes even 
further by dlscussi^nj?- theV imol ieat ions for orn^an izatlonal 
structures. His philosophical apprqach^i's a bec;iiianin<3C.at 
describin^c the "con^Ltions .exisbincr in oferafiizationsi that 
would b^ , affected by AHI technoloc^y. " 

The puroose of DELPHI is to establ.ish^a meanin^ul ^ 
ctrouD commun icat ion structure, accordinc^ to Turoff (1971, 
317). He ores-ents the criteria for mean ing fulness and then 
'aporonriate apolications pf DELPHI'. One'of^the cr^eria for 
meanlnpcfulness arises out* of the effect, of comput( 
conferencing, which is: . 




...the errouD or^ssure ^ restrict discussion td^he 
meat of the isisu-^.^ Verbose statements alvraysj ten^*vto 

, receive ^bw, acceptance, votes and individuals* quickl; 
learn, "because of this, to sharpen their position, if 

^ -they wish to make a point (Turoff, 1971, 321.) ^ 

* 

The or^oblems inherent in la.rc^e o^rctan izat ional 
structures 'are reviewed , such as the need -for hierarchiQ.^i * 
structure, the, increasinel'y complex envlroriment , the leflfects 
of size, and the resultant lack of effective aommunic\at ion - 
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and problem solvins^ capability. He notes the inadequacies 
of formal communication channels. ' . ^' 

The result is a <3:rowl<lT^ lack in many orpanizat iona of 
effective communications about various problems. The * 
individual pereeivint?: the situation faces a choice of. 

* either est abl Ish in«? informal communication channels and 
oerhaOs suffering .the consequences for bypassing -the 
established/ modes or sufferinc^ in silence and adaptfac: 
a f^ame playini? vattitude toward the communication 
process available to him . When this latter att itude is 
characteristic of a lari^e segment of the organization, 
there is no loneer an effective human communication 

• orocess and individuals become isxtremely unresponsive 
to- attempts to effectively deal with problems (Turoff, 
1971 , 323) . ' ' ^ . . . 

Although the use of the computer might be expected to 
be a potential solution to tl^is very common downfall in 
o'rj^anizations , Turoff surprisingly interjects a possible 

failure for this to occur. * 

I* 

Psychologists would agree that given the alt,ernative of 
an unresponsive human commun icat ion process or a 
responsive man-machine communication proc,ess moSt 
individuals will shift their efforts at commun icat ion 
to the machine (TuroYf, 1971, 323). 

This is the real danger with the^ ftHI system: that it • 
might act as a surrogate fo> jeffective communication or give 
the illusioh that ^eifective. communication exists. This j^-. 
effect is fundamental anrf will be closely observed. in this 
atudy.. Certainly, trtf AUi^ system will affect the 
communication process Z \ * ^ , 

A sessio^^f' the Intern'«ut ional ConTerencjS on Computer 
Com^^unicatlon^li^ Fall of 1^12 , was 'devoted/ to pn-line 
conferencing or •^^L^e-conf erenc fng" . The session cljairman, 
Gonrath, clearly established t^he extent of the work which 
was represented by^the 'papers presented fit this conference. 
He outlined the issues .and t)osed quest ions Which are,, 
summarized by the ' auest ion , "Why hasn' t more been done on 
nan-computer-man communication and the augmenting of 
interpersonal communication'^" He indicated concern that 
"...he could not find a wider v^r iety o.f\ research ... " than 
that represented in his sessi-on *on "assisting man-to-man » 
Interfaces and related issues '( Conrath , .l972b , 146)." 

Althouf^h the literature does not de^ with the ^ , 
important questions of ^^f feet , as Conrath points out, his 

. / \ . ' ' 
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own work does. He orovides a conceptual framework', sv, 
definitions, and a ,methodoloc:v for invest ij?ati>nt?^y4he. y ^ 
computer's imoact on orf?anizational st ruc»ture ,C^nrath , 
1972a). This is unlike other reported work-in t;iiat it deals 
with the -process that is an organization rather /than/ the 
resultant oroiari izat ional schemes*, such as what departments 
and management positions should be creatfed to mana.c^e 
computer ins'tallations • He describes*^ an »brc:a?ttization based 
on an excellent (and pbvio^us) definition. An ort^anization 
is a set o f . in terpersonal networks, each of which is based 
on interpersdfial relation^ comprised' of the communications 
amon^ the members of that orfican izatipn (Conrath, 1972a, 68). 
The elaboration that follows represents a great insight into 
the workiniys of organizations, which is supported by an 
empirical studv. 

Conrath employs a field atudy methoddloG:y using a 
rood i ficat ion of the Quickborner "communications tally 
sheet." The overall ^oal was to^obtain data about the 
Drqperties of an orsranization based on specific 
commuihication events with minimal disruption (Conratfi, 
1972a) 71'). This would then provide-^ context for the - 
measurement of*imT)aot on organizational structure , i .e* j 
change. This methodolos:y for measuring the organizational ; 
impact o|^ the -.Qomputer may be appropriate for the study 
proposed here , and will be discussed in detail in the 
section on ^methodology . It is interesting that Conrath does 
not Tnention AHI per se , but rather in general. y 

"fhe' important impact of the computer l^ieS in the . ^ 
develoorfient of 'software that will allow it to assist ^ 
sitnd aue:ment interpersonal interactions (Conrath, 1972a, 

72). ' . - \ ' . 

Thu3 , Conrath assigns Substantial , importance to trie. AHI 
System technolocyy. H6w the\system purports to augment 
interpersonal' interactir)ns and what in fact it actually does 
wiJ.1. be described by this inves4:igation . 



. ^ ^ Hypotheses , 

•The literature ^indicates - that there will be effects on 
the. individual, the communication among' indiv iduals , and the 
*crre:anization . Consequently, there . are . three major 
hypotheses that are concerned with effects on the population 
in three areas: ( 1 J the individual, (2) the communication 
-in Rroupis and teams, and (3X the organization. The 
hypotheses represent the effects that are ultimately 
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exDected/-as the population* becomes an "'Au^;mented Knowledge 
Workshop^' which is described below. 



r. The individual's verbal, thous^ht processes wi 
aided Noy t^he rar>id Availability of his; ovn infornatioifi 
ease or^ chanQ;ing that information both in^-its coptent 
struct.ure, and the flexible control of structure- view 
(cf. .EhfTelbart 1973). 



1 be 
, 'the 
and 
ng 



The. T|,frft|^ity of written in formal^ion has a relatively 
unexjDljbHqpi^Pfec t on the development of a per son ' s Vd(jas , 
^ th6uc;hts ete . - He* traditionally is limited to handw^^i^tinp; 
or tyoin^ to make thoughts initially visible, and theri to 
rewriting each time clarification, correction, uD-dat:.hNg , , V 
r^tructurin^ , etc., is necessary.^ This may reauire the^ 

* intervention lof a typist, and communlcat ioH' o f the necessary- 
chancres to this second party. ^ The longer the oaper, or 
whatever, the greater the problem of revision. Once a 
lengthy oaper is prepared, the thinker* s ab^ity to message, 
manipulate and creatively deal with those ideas is 
curtailed . ' * 

When ^thoughts , etc . , are entered into the AH I system , 
it is predicted that they will not lose -the flexibiltiy^ 
inherent in . the. tho.ught orocess ,* but conceivably. wi^lV gain 
additional flexifciility resulting from the , visibility/ of,; ---^ 

.written information.. The capab il ity'^s^f AHI^to permiA rapid . 
Qhanges in stored text of : any kind was "described in */t>hp , ' 
'Introduction", ^rom this it can be expected that Tan ' 

' individual will\ove through, his atored* ideas'^w^n grekt*^ . 
ease massagirter, and creatively engaging- words, /concepts^ 
facts, patterns; and the various ^nuanc^s^ of recorded, * 
thought. * He* al so has ,\ at any time, a copy to s^hare with 

^ whomever he chooses . * . • ' 

* -* * ♦ ■ 

^.In addition to the/flexibility gained, the. hierarchical- 
structure adds what^^T^iay be a qew dimension to computer 
stored thought. T^fie structure' permits verbal units- to , be 
placed at a level indicating relative ^importance , source^^ . 
catectory, etc. Thus, it is ored^ic'ted that relationships can 
be captured or established which otherwise mi,ght*be obac*ured 
bv semantic limitations. ^ . ^ , ' 

X ; r • . • , - . „ 

2. ^ The» co.mnfunicat ion of individuals accomplishing 
their work on the. system will be facilitated by the free 
access permitted to all individuals* work as structured into 
the sys.tem,' by the .ease of making changes in the written 
' wbrk.of gro^uns , by the capability to tK'ansmit messages or 
otnbr *in formation, throue^ft 'the computer , and by the • ; . 
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caoability to simultaneously access and modify stored 
information by fium'bers of persons. ' - - 

* " • ' 

' Knowledge may be collected and compiled thus takinc; 
'maximum advantaece of thpe resources of the"on-line workinp;; 
^rouo resul-tin? in better decisions and actions. 

The result would.be an " AuQ:mented /KAowledere .Workshop" 
oromotiner the Integration and synthesis of t^^e efforts of 
individuals t6 yield a t^jevf level of group creai^ivity . 
Con'sensus woirld 'represented by a stored record^ created 
•simultaneouslli^ , o^vdr 'time . The leaders of the Augmentation^ 
Research Ceht^rf (*ARC), Mssrs. En^elbart, Norton, and 
Watson, elaborate on the concept of the "knowledge workshop" 
a,s follows . A ^ , . . 

The term." '.'knowledge workshop" is built directly upon 
^ the terms "knowledge work"^ and "knowledge woi'^ker" , . ^\ 
^* 'who>se special use "is from *Peter Druckej^ ( 1969). He ' 
develons a much larger 'theme about these consents', 
adding terms such as "knowledge technologies", r 
"knowled?^ economy" , and " knowledge soc iety" , and , 
' Pointing out that^'the growing level and imJ)ortance of 
knowledge-wo activity in our society will produce a 
discontinuity in our cultural evolution of ^ scale . 
commensurate withN^that of thp^ industrial revolution. 

^ The knowledge Worktop is the specially provided 
. environment in whicn^ knowledge workers do their , . j 

kno^iedce work. We can talk about a small knowledge 
, workshop for an i)ndividual, t)r a lairge ^knowledge 
workvShop for an organ-jh^a't ion . Knowledge woricshops have 
existed for centuries, but here we consider maximizirrg 
their effectiveness by systemai>ically evolving tools , 
m'ethods, etc., witjj^ heavy- depertdence .upon the new y 

% tec*hnalogie§'of computer time sharing and ne^tworking. 
the result is the " Augmented, Knowledge -V/orker" (AKW) 
which descrij^es an ^individual^ effectively ^usirjg AHl. 



\ ' ' ' , 
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Basic . wbrkshbp functj^ns will serve the daily handlipg 
of the AKW's workinc; information • — j^of their notes, ' ^ 
' thin^'s-to-do^ lists, memos, letters, a^sj.<;ns, ol^in-s,. 
budc:ets, announcements, commentary, proposal's, Vteaorts, 
orofiH^aras, documentation, item-control catalogs , -^tc . 
And before it can sensibly be of much value^ as 
Enscelbart jias- stated, the^ Augmisntation. .,Sy.g,tetrt. has to ^ 
orovide for the crrubby cut-and-try detail involved in 
* tjfie minute-by-minute, day-after-day worker's handling 
of tfiis inforcnation: in ^the-user's composition, 
studyincr ., cornmentin^ upon, arguing about, modifying, 
communicating , Dubllshing, presenting , etc . 
(Eri^elbart^ Nortpri,«Watsbnv 1973) ^ 

3. The 6aSe of .handling Knowledge Worker tasks and the 
openness ainong AKWs will have a strong impact on an * 
organiZsation where groups and teams are augmented, by 
facilita-ting t4ie vertical communication *in that orgatoizatidp 
and- ultlma^elv , the ore:anization itself. 

■■ ' • ' 

When the AKWs are at all levels in an organizatioh , 
manae^ement and . subord inates can communicate throu^srh the 
system with 'the same ease that co-workers c§rt in^teract*. The 
message, transmission capability would facilitate the conduct 
of most'of the organization's busitless through AHI. 



The tradeoff from these increases in communication >^h> 
historically been a \Logs of efficiency (ef. March, 1965). 
However;, a very important product of AHI is pVedicted to be 
the^ implementation of modern, "oben" management techniques 
witWut '#oss of efficiency. *' ; ^ 

these hypotheses are interrelated and interdependent . 
The methods to be used will :<nat dealVwith each hypothesis 
'singly,\but data will be provid^ed that can be interoreted -in 
liRht of^each hypothesis to support or r^.tect it. 

v . . ■ . . ■ ■ ' ' : ^ ' ' ' ■ ' ' . - ' 
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se.ction II - 
METHODS AND PROCEDURES - . . 

^ • 

In ordfer to/obtain mesfningful data illuminating; the . 
effects of \the;^ufi5rnented Human Intellect System, §very 
reasojiable T>e^n ique has beq^n emoloyed to docum:ent , as * 
thoroughly as opssible, th6'^ proce^ss of evolution to the - 
i4Tte<?rated use of the technology on a' daily^ basis, 
narticularly for communication. This study reports a.^ 
milestone in that ^evolution after seven months ofSystem use 
on an • experimental basis . ' 




ackground 




- The /ollowinff ifiethodolpfiricai assumptions arQ m 
this study.' _ ' 

« (1) If the System ha§va& effect^. ( positive 'or nega'tive) 
then that e,ffect-will resippftn a dorresoohdin-g measurable 
change in ' thie* attitudes of System users, toward th^ 'System 
and ^ener&l technology that it represents. ^ ^ ' . v 



(2) Measuring' tfie attitude of the population involved 
is one valid way of ascertaining the. effects . Attitude^ ? 
change results primarilv from effectiveness, an4 cohverseLy , 
attijtude stror^e^ly influences effectiveness. It is also a 
desirable met.hgd due to *the indirectness by .which, data is. / 
obtained. However, a priori attitude- will affect *t he 

, Dropensity to use the\Sys\em. This use -is- necessary , to 
cause any attitude change,' while' positive •Sys'tem effects 
will also be dembnstrated by in/fcreased or cantinued System 
usaGce. (Attit^bde change "due US . maturation will be.note0 by' 
conpafrison to a control group/) 

(3) It fpllowfe tjpat attitudes will vary directly with 
chancres in commiin ication aijionj?; the sub jects . \ 'Thus , improved' 
communication, horizontally or vertically, would result in 
m"ore bosit ive ^att itudes . , ' / 

..^ ^ ■ ' : - - \ 

{HI ResDondant reports are a valid means 'of acertaininj?; 
chanjres in per form ance/eft'ect iveness / Although ^subjective , 
a user's judc:ements about the ''utility of a tool to him ^re 
reliable iiat=3 when there is' a significant n.qmber of userjs. 

Based on these assumptions', the invest igatibn is a ; 
descriptive^, fi'eld study. Oufestionnaire;^ and direct \' 
observatio!^ ar'e the primary sources of yata-. Th'ere 'are $ix 
specific types of inst ruments , * ( 1 ) a chronicle, of qomments* 

. • • "^-^ ^"■^ ' •/ ■ . ■/ ' . ^ ^ 
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and bnstructOred participant observation, (2) case' stiljrly 
.descriptions/ ( 3 ) in terv iews , (4) a controlled attitude 
questionnaire^ (/5 ) a^conterit questj^onnaire and (6) a tally 
o f. cdm<un icat^on • '^ransactTons ^ In fluent ial vaf*~ial)les, 
jeroDulatdon/n^ factors and J6b task- type, and ^ ,. 

prof ic'iejprc V of use relative' to the total number^ ©f hours <pf" 
use, a,re* reported • // ' j\ ^ 



PoDu/lk^at ion Character is tics «^ 



v The population /for this study is ;Jre-determined by- the: 
orf2;anizat ional .'structure where th^. System is bein^ 
implemented. * Two similiar or^alni'zational unita„ are employed 
as the experimental group and the control erroup^ , 
respectively. , ' ' • ' 

, The ore:an izat iqnv is a c^overrtment research and 
develooment lab'Oratpry dealing? primarrly with electronics. ^ 
The copulation is within a- st i7.uctui7''^~"slDec ial izing in 
^information, science vihich 'develo-ps tesVs , and evaluates 
certain kinds of complit§i?\softwarie\ Almost* air personnels 
are colleeie educat/ed, and "a sizable percentage have ^ adyary ed 
des:rees ( see Appendix A . - 

The kind of/,work done by the pof^ai'ation could ^have 
important bedripg on the. interpretation of the re^ults;^ 
Thus," the invest i^ator establis^^ed a framework which was . v 
us'e(i to categorlzg What kinds 'o f ' work Inyoiyed what 
peroentaeie of the-^oerson ' s time. ' \, * 

- *. ^ ' ' . ■ * ^ ^ . ■ *" • ■ , 

.The list,/of "job task types" was cr*ea.ted by the 
investigator in t u'it ivel V f rom observatio^ and , discussions ^ 
With members pf the oooulat ion . A , pilot study of a -cross 
sec'tion o^f the Dopuiat^ion resulted in 'modification and 
validation ol^^j^e final list, which was foun'd' to be. 
representative. A semi-structured interview was- then given. 
Th'e subject? Were asked to determine ;the -percent of time 
spent, in each ^lob tasl< type. V , This is an indicator of any 
^differences between sub-grouns or the- test group and th^ 
Qontrol gro,up' which cou^d act a*s spurious variables. 

( 2 )' Measuring the attitude .p'-f the population involved 
is one valid way of ascertaining the effects. Atti^de 
change results 'orimar ily f rom ef f ec tivenes-s , and conversely, 
attitude strongly influenbes ef fec%ivenesa. It is also a 
rjes4rable method di}e to ^he 'ind ir.ec tness by which data is 
obtained.' However,, a'. priori attitude will affect the» 
propenslrty to. use the System^ This use Is necessarj^ to 
cause .ariy attitikje change , whi4e posit ive System effects 
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^will also be lemonstrated by increased or continued System 
usa«^e. ( Attitude change due to maturation Will ' be noted by 
comparijson to a control group .) * \^ : 

.(3) It foilows that attitudes will viry directly with 
chang.es in communication^ among the subjects. Tftus,, improved 
communication, horizontally or vertically, would reault-in 
more positive altitudes. 

(H) Resporr^ant reports^are a valid means of -acertaining 
*chani?es in Derformance/ef f ec^iv:e^ess . . Alth^ough subjective, 
a user's judprements about the ut'i7-l"*i\k^ tdol to him are 
^ reliab-le data when th^re is a signifia|^ number of use'rs.^ 

Subjects were assigned to sutj-groups within the 
ori^anizational unit based on age, length of service .time , 
ralnT<, job tSisk type profile, and type of Dosition (manager, 
encrineer , ;admi'rtistrator , clerical, and experience With 
computers )' . , * < ^ 

^ ' Job Task;Types (trener^l catag^rles of job activities 
that are accomplished by the population): 

1. Programming • , 

2. Pro ject^ engir^eerincc , including: con^ff'^t paperwork 
(forms memos', etc.); reviewing proposals and reports 

3. Writing plans and/or reports - 

4. Software o*peration ( including' evaluation , debugging 
of software o^ckacres)- 

5. Br ie'f inccs , . - - ^ =^ ' 

6. Demonstrations of systems' 

7. Manaprtn»? other personnel ' 

8. -Administrative paperwork ' \ 

9. Study, review of the state-of-the-art, readingV 
' 1 iterature jsearch ; ,et6. * 

10. Secretarial work.' 

^ " (See. ^Ap/0endix A for subject job" task type and ' . 

• d'emogranhic/l|j>?ta'/) 
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Observations of Effect on Behavior 

The -most- "^straigh'tTorwar^ means -^O' understand the 
orocess and effects this- study is concerned with is to 
d^e'ctly observe the behaviors of the population during the 
oeriod of exposure to System usage. It is ,par ticularly true 
in this instance because there are numerous problems and 
•events that cannot be arttit* ioated — this is the first 
System imolementat ion for non-developmental purposes. 

' I ■ . , y 
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Therefore, closed ended "instruments , such as (questionnaires, 
cannot be relied uDon to capture all behavioral chajiJ^es. 

It is imifartant to document the spec if ic uses of the 
System which 'are an im*Dortant indicator of effectiveness 
if the the System is selected as . an alternative to 
^conventional means, this clearly demonstrates that there is 
some reward. This was recorded in the Chronicle ^ ( see below) 

with any other .user-entered experiences. 

■« ■ 

However, the presence of reward does not necessar.ily 
supDort the hypotheses; other factors such as novelty and 
<;croup Dre'ssure could cause the same results. Thus, the 
question must be asked of the users: why, in fact, was the 
System selected in partiolar situations and what experience 
resulted. Interviews (s^ee below) are used here. Aj?ain, 
this informati.on does ' illuminate im'portan t> mot ivational 
factors, but it is. limited to conscious reactions, subject 
to influence by the situational set. 

System- uses.and the interview data may be corroborated 
by noting the actual accompanying behavior. .The resultant 
C3se bistorv provides insi^?ht on the basis of actions) a <^ 
most important datum that.ig possible (and necessary) to 
colj^ect when the the ooDulation .is relativel y small . , 
Direct^, serendipitous observation is possible because the 
observer is co-located with the population and has the, 
oDpqrtunity to interact .with them on a daili^ basis (see 
below) . 



The Chronicle - . . 

The Chronicle wa3 established as a vehicle for 
recordiji^ the sereg^d ipitous experiences by members of the 
Dopulation thr'ough the System. Any experience that was 
oerceived as noteworthy by a subject was .recorded in a 
soecial file^ named CHRON in his directory or in that of the 
sinvestiga'torV The investigator then perused the files of 
the DODulat'ion and compiled a^summary, collating and 
synthesizing similar 'events. The voluntary ^selection of - 
events was not expected to yTeld more than a record. This 
factor is^ important for realistic interpretation of the data 
which are" not representative. ♦ 



7 



Personal Account 



The lnvestif?ator has been a-uaef' of the System for oyer 
a year and has been usinR the display System for about seyen 
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" rnonths, since its initial' availability outside th^ Stanford 
Resear»ch Institute, Thi.s, as 'well as other *t)apers , has been- 
Dreoared^ on the System. Thus, my experiences are included 
wherever^ aoproDriate, 'par ticularlv' in docurnentinjGt the uses 
of the Svstem both for conmunicat ion and 'for effect on the * ^ 

individua.! • s thdus:ht orocesses, bwt not* for motivational 

. " attitudinal data. x ■ . . a. 

Interv lews " v . ' ' - ' 

* ' ■ '"...*•■■• 

• - Interviews, were conducted at intervals throuc:hout . th*e [ « 

• . De»rio*> that' becran with System availability to' the ^)opulation ^ 

of 20 persons. Jwo non-membecs of the or^anizatioHe were * . ^ 

enoloyed to conduct unst.rtfG t ure.d interviews that .allowed^the 
maxinun oooortunity for open* ended resoonses*. Hopefully 
this enabled the respondent to" in troduce those' thint^S tSfhich; 
^ were most imoortajit to^him, while minimizinPt the st ru^tu^lno; 

of these^oerceptionsbv the interviewer. General questions 
sucti as,^ "Could .you tell m% more ' about that?"J were followed : . 
'^bv more soecifin Questions dnly when deemed necessary by. the ' 
interviewer to"" R:ain so'meornore detailed information fromf ^ ^ 
reluctant^respondents , The in terv lews awere non-directiVe to ^ * ^ 

^ t.he point of resemblinc^ a ^discussion Although the st^ie ^ ^ ' 
was intended to be Roe:Qri?in, suiT't^estions were u^ed when 
V certain Droblems were an tic tpated e^ . " Did- you have trouble ' 

^ with outj)'Ut directives?." (see Aoo^ndix H) ^ V * > 

Direct pbs^rvation . . 

'The- investigator ' s Dosit ion xwas -sf vantapce point from ' * 

ioh to jRther empir icalv^ata Events were Recorded as 
they <1rew*the attenti^on of the investic^to'r./ , Oportunities • ' . .. 
for this kind of ob^serv^a^ioo include^l -corfvepsqitions that ^ ' ^ 

wi^re oyer+ieard ( "eavesdroppino;" ) , ■ nsandogi. Voarticipatioft in 
conver^sations t sessions arisin^^out of -a request for , 
assistance on the System'^' observinG^ tb"e process ^^€vf document 
ore'paration and the* end opoduct of SyTstem use, and - rev^iisws 
of the contents of subjects* file^^. ^' ^ ^'^ ' ' 

This feind of record is* highly imore^sionistic and is 
deoenderit more than the other techniques upon the 'observer * s^ 
berceotijal ' set . In this case it was mitigated by the^ ~ ' 
workin'? environment in which sub jects were non-volunteer3 
involved primarily because o f their ' lOOiation ip the - • ' 
organization. There were no direct rewards for . • 

;articipation. and no lessening o^f the workload impos-ed by ' 
man^eremgnt . A minimum ^'of a4d itional obtru^sion into the' ^ • 
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workinct world of the . sub jects. was ' imperative , thus 
supportinfl^ the use of techniques such as this onk . 

The combination of the^ methods was Intended to be 
synert^isti^ -- each is subject to relatively stroficc 
sub jec t ive fb ias . However > the combination- is capable of . 
providin<t 4 valuable descript'^on of the effects and impact 
of. tfcte System on the ways in which thjp subjects behaved 
while accomplishing knov/ledsje work. 

^: Cjjntrolled Attitude Change Measurement 

' The " T" Questionnaire (see Appendix C ) was employed to 
measure possible effects on the attitudes of the population., 
The assumption was that changes in attitude towar^ the 
System technplogy and the working environment, observed in a 
coat.rolled format, would oermit conclusiorve to be drawn, 
about the efjfectiveness of the Syste^m. 

• T-his .is a standardized attitude quest ionnaire . which was 
desir^ned to measure the subject's general attitude toward 
the AHl concept/technolocty ; pretesting before contacting the 
'Svstem and then after training and usage, A four position 
scale Drovided a forced choice decision. The positions were- 
labelled "strongly acrpee" , "agree", "disagree", "strongly 
d isa^fiee" . ^ 1 

iThe '*T'' Questionnaire was given to Qne group of uaers 
before us^ and^dne^ group of non-users as a* control. This 
constituted a pretest, and provided the basis for comoarison 
with the results of the ^same/- quest ionnSire after full usage, 
of Syst-^m. The ^lit groujK oretest is a control for test 
effects ^ ' ^, 

* Thece were numerous factors that could influence 
a}:titM^^s other thar> the independent variable, orimarily due 
to the"\smali noDula^tion' size . These were identified and all 
the* in formation available concerning each was 'recorded . 
This was then included as part ^of the data base for 
analysis. In this manner, correlat iions were more reliable. 
The potentially sourious variabJLes were grouped under the . 
following headings: y , 

• ( 1 ) PoDulation characteristics / 

The description of the oooulation included Job Task 
Tyoe, a^nd demographic character istics , including age, length 
of government service*, position (title if*a^ manaorer. 



Bair: AKW^ Evaluatioh ' Page 22 



30 



otherwise scic-fitific specialty), and Hknk (see the section 
on Dopulatlon.) . 

(2) Training 

Training was as nearly the tamerfor each subject a3 
possible .although much of the learnincr occurred throur;^li.' 
System use. Learnincr time was recorded from periodic 
interviews, quest ionnaires , and/or System maint^ained usa^^e 
.records. ^Whenever possible, the records were maintained 
from the first trainins^ or experience with the System. 

(3) Pi^of icienc\N,> 



proficiency in th.V use of the teletypewriter yersion af 
'the System was measured near the e,nd of the exloer imen tal 
Deriod ; Thfe test ' consisted of a parao;raph of text that 
contained numerous errbrs^ and a corrected version with the 
.errors nark^ed . , The subject was asked to copy the incorrect 
'version into his computer space, edit the errors as 
indicated on the correct version, and then send the 
corrected copv to the experimenter. Subjects were also 
requested to use thef other communication modes to notify the 
exoerimenter that he had comoleted the test. (See the 
Exercise' in Appendix G). ^ ^ 



: The ty.pe of term inal used ^ and the availablity of the 
terminal and Sys.tem , was no tecjl -on a " percen tar<;e basis . - Of 
.particular concern was the' d if f erence resultant, from the use 
ojv^jjie^C^RT (TVrlike^ terminal) and the tele-typewriter 

erminals. Connect time to the System wa^ recorded 
autonaticall v . * ^ 

(5) Orts^anizationa^ Climate 

The OrganiMtio^nal Climate Index (OCI) (Stern, 1969, 
and Richman, 1970) was employed ^to measure the differences, 
if any, between the control and experimental eirouDS and 
sub^rouDs based on the demo^raohic d'^ata. 

'The OCI, as the title indicates,, is desic^ned to measure 
the climate that exists within an organization as perceived 
by the members of 't^hat orc:anization . These perceptions 
ultimatelv affect how a- oerson feel? '^bout the Dlace^/where 
he works. This is a result of, at least for a large number 
of persons measured toftether, the climate. The/ 
questionnaire was wdesrqned to be as indirect as possible, 
thus relievinq;' the individual of the moi^e subjective burden 




(M) Terminal -rairsiil ability and -tj^pe 
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of judfijinc: * hi^ Job enYironm^t. Instead, the test includes 
300 states 91a t*s about the kinds pf thini^s t*hat can. .^o on in 
the ore'^inization which are rated true or false • ^ 

• J , .> • ■ ■ .. 

A wi^orouQih* 3tatistiK3a.l analysis by the Syracuse 
University Psycho(?ical Research. Center ' s' computer pr'Ogram - 
^oaded " the St atements on .J8 factqV's (see Richman and Stern, 
1969) which are descriptive oTR organizational climate-s in 
creneral, and hav^ been test;ed at other institutions for 
-validity and reliability. 

Thus, this test orovided an excellent clinical 
experimental control as .well as a pretest for future 
investigations (a year or' so hence) which mij;ht compare "th^ 
results of a posttest to determine if there^ is any effect gn 
the or(?ani2ational climate by the AHI System. 

Structured Observations and Commun icat iort Analysis 

* • . * 

Content Questionnaire '(^"Q")' - r 

V . ' ■ , - 

^'Q" was administered only at the 6nd of t^he ' 
experimental use 'Oeriod to determine the 'specific reactions 
to use of AHI by those who had reached a functional' ^ 
oroficiencv. Th-is- included questions on the type of 
terminal , Svstem availability, effect on, worl<load , 
'lisapDoin tments erhcountered and particuljar us^s (see 
Appendix E). Two tyoes of .questions were used: .^^ 

1. Five positionr Likert type- scale questions which 
dealt with the effect of AHI on specific daily behavior 
rout ines , espec ially communication. 

2, * Multiple choice and open ended questions were 
employed to eather information about the percentacre of time 
the System was used, problems not addressed in the 
chroniple, etc., to establish, any oossible cause of spurious 
effects. 



Comtnup^ioat ion Tally Analysis 

donrath's communication tally method ^was applied to the 
entire population and an additional level of manac^ement as 
well. As suj?c:ested in the review of literature, this' is the 
best method found for obtaininc: data that can firive an 
indication of {he chanpres in communication pattern-s -due to 
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the use of the. System, -torrinunication events were recorded 
for a period of approximately one week. ' - 

.However, difficulties that cannot be' solved a priori ^ 
were .anticfoated . Conrath (1972) noted the potential loss 
of reliability due to the surfacinc^ of Inhibitions toward^" 
Dart ic ipation . Uaincr onlv volunteers assures some • . 

cooperation in f irl ing . out the extensive tally sheet, but 
there still may he a problem when the subject finds himself 
with a sizabl,e burden in addition-to an alreadv heavy 
worklt)ad . 

' The Donulation size for this technique limits 
^eneraLdzateion« But some prediction, includincr the, 
establishmenvt of the communication network ( oatterns ) , was 
Dossihle, especially since subjects were ^from hi^^her level 
management as well.,as from^^ the ftottom lev'el Any change 
(i.e... use#of the. System to con/municat e ) will increase the 
Dr^obability^that AHI will caus^ these changes in other 
persons .as well. This'' technique will have to be 
exploratory, but shouXd be i^^:::erest ing at the verv least. 

^Another oroblem w^s the \represen ta tiveness of the time 
Deriort that *was used. A five\^ day oer iod was selected with 
th6 ful^ realization that this waS a short tim^ sytd fnight 
not be representative. However, it has been a5^certa.ined 
from exoerience that this is the ma'ximum time, that such a 
DOpulation can be expected to cooper\ate, with the additional 
load. (Conrath, t)erson^l communication, 1973). The short 
time deriod notwithstanding, the ''dataX should be sufficient 
to draw some conclusions. .V 

The technioue involves recording iWerac tions in a 
binary fa'shion; either an interaction h?vs taken place or it 
has not. The interactions are defined aa essential 
interpersonal communications , on an in ia ted /received , whom 
basis, by mode, elapse'd time category and rjumber of Dersons 
involved'. "Essential in teVpersonal communieations include 
all interpersonal, in teracfTions except for personal 
greetings , ^when r'estric ted to no more than that, and 
requests for f%j/|^.urs , sucti as 'do you have th^ time?,' that 
were dependent Wiely upon physical Droximity*\^(C9hrat^ 
1Q72b, II) Al;li/e vents are recortled by an* "R" mr r*eceived, 
and ah/'l*^ for ''initiated . The tally*sheet (seeVpoendix I)> 
is a com.plete representation of^ the information rhat is 
recorded. \ 

This tally she^L has four, additional categoriesV for tihe 
^use of the System: link, send messat^e, shared files, \nd. ^ 
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Journal subsystem.. In this way the quantitative chancres in 
the mode of communication af'e noted. . , ^ 

Data on the authority structure, physical location^ \ 
(office landscape), and other factors were descriotivel y \ 
recorded in the section on pop^yilat ion . Of importance -were 
chanc;es in the vertical channels of communication within the 
or<?anization where the mana{;ers are aucjmented and thus will 

^'ave the oomDuter. based modes of interaction available. The ' 
traditional difficulty of com.municatin^ with managers may be 
overcome, but circumvention "of formal authority channels 

:might become a problem. The instructions (see Aopendix I) 
were modified for use with this particular population. Data 
analysis was done by computer tabulation of the coded data. 



/ Design Format Showing All Questionnaires 
GROUPS PRETEST TREATMENT POSTTEST 



USER 1 
USER 2 



(I) T, 



CONTROL 2 



OCX 
OCI 



X 
X 



CONTROL 1. (IV; T, OCX 



OCX 



(XX) T, 0 
(XXX) T, Q 

(V) T 
( V J ) T ' 



The design format shows. the spliU^alf "T" 
Questionnaire oretest where half the ^iser grouD and half the 
control e:roup did not receive the ^nretest . These groups 
were assierned Roman numerals for, the purpose of computer 
data processing. The OCI was civen to all subjects at the 
time of the^ oretest to control for group differences, etc. 
The VQ" Questionnaire was given only to the users to gather* > 

^specific reactions to System use. 

<■ , . ■ ■ 

This is a non-randomized Solomon four-^group design wi 
a small N. Th^ N of approximately 36 (4, groups o 
necessitated the non-random selection of subjects 
s,ub-f^rouDs,. (See the discussion of the ^population . ) 

The ateove design is constructed to control for test 
effects of the "T" Questionnaire and time lapse changes' 
during the Experimental period (population maturation). We 
cannot 'chans:e the group membei?ship due^^ to the fixed 
organizational structure. Th^ demographic profile provides 
a check on subject differences that might affect the outcome 
( Appendix A ) . . - ; . ' . 
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The d if f'^rence between the pretest and ^posttest is the 
kev measure of differences due to the treatment. However, 
the n,ature of th^ *"T" cutest ionnaire may cause test effects 
after the pretest thxis confoundint? the .posttest . 
Differences between the >Dosttest for subt?roups (T) and (2) 
can be attributed to oreteist "T" effect since the sub^^roups 
(i.e. the .sub-division of the^ user and non-user 'gpouos ) atre 
matched on all other known variables.' The key test effect 
is predicted to be an incr^sed awareness of th^ technology. 

• This investiG^at ion nas been designed to slather 
information about the erfect of the AHI System ' durinf? the 
Process of imolemen tation emoloyint^ as ''many, d if f erent 
techniques as is feasible in a real world, working 
environment. The ^purpose of this "shotgun" approach is to 
compensate for tj3^ limitations of psychometric techniaues* , 
apDlied°in a non-laboratory^nvironment . The effects thVt 
are being investigated are so novel (never having been 
examined ;be fore) that' a detailed account of the process of 
^im'plementing an Au<;rTnented Human Intellect Svstem wauld 
orobablv be a sign^if ican t contribution in. itself. 

The following sections are divided on the basis of the 
Hata collec tiiTn^technique . ' It is hoped that- eaeh section is 
just a beginninglof the analysis of the effects of what 
Peter Drucker (]/967') calls, the "-knowledce revolution" 
(analogous to trie; industrial revolution) for which AHI Is 
the prototype tool. ' - 
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Section III 
OBSERVED BEHAVIORS 

Learninej to be an ^ Auf^mented Knowledj^e Wo^rker 

The resi"stance to learning' a new' System as i ^way of 
. doinc: one's dailv knowleclc?e work vas hit^her than expected. 
Traditional work patterns ^ were adhered to vith a ctreat deal 
of Dersi^tence by the poDulat ion , a manifestation of the 
^ < "rejection phenomenon."^ This occurs frequently upon the 

^'"introduction of n§w techrvology ; however, it was surprising 
^ '-in this context. .It demonstrates that education ^ and an 
\ understand ini^ -of tlje technology in general are nit 

prereouisites^ for immed iate acceptance . In addition , in 
this case the methogjs of communicating and accomplishing 
' 'daily work are habitiial.^and . coiisequently some extinction had 
. 1 to^^occur 'before .riew-hab it*' could be^learned^ \^ 

* *^ ' • • 

Excuses forgot ihiiryg the* System were exemplified by 
, J comments such as , " therje isQ ' t a terminal around , "s " I can^t 
refTiember Jiow to do it, "v "there iSn't a good manual that I 
can understand," I hav6" too *much ^ work to do," etc. It 
seems worthwhile to dis'cuss s'ome of these, how we deal't with' 
them, and offer some spec-ulation- about the reasons behind 
this behavior i/ (The problem here, of course, is that the 
' ■'^ reasofts are la^ria^ely a function of individual oersonaiities. 

With our population size,, ' any general ization must be done- 
/ with, this factor in mind.) ^ 

There are twelve portable .ty^writer terminals and 3 
IM-LAC displays for 20 subjects. Tn^ jo^s for aooroximately 
70? of these individuals require- a ^reatXdeal of written 
work. An imoortant exceotion is proWammins: for another , 
' . Syst'em. This 'is a major task for at\east one third of this 
DODulation and has not been done on AHI. VAt SRI; however,^ 
all pro^^ramminp; has been done on the SysteA-since its j 
inceotion. This will be di^cus^ed further under the 
head insj , "Population, Characteristics 




Terminal availability; is a crucial variable af fectin<t 
the learning process, Tl^ere is st rgn*^ resistanc e to leavinr^ 
one' s-, work 3Dace to work in another or to physically carry a 
terminal to that area from some other work s^ace. Ideally, 
every user would have his own terminal. '^is is not 
warranted by current usa^e levels here, ^no^ is it feasible 
financially. However, it has id'conle a problem "to the poinjt 
where it caused ,some people not to use the System.^ 
(Management and the observer tried tb overcome this b]/* 
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carryinfi; terminals to people who have^use fpr them but 
resist Gcettinn^ their own.) * 

*> . 

The System use manual cannot serve as a training ' 
manual. It is over 200 pacces in length and ^is not organized 
in a self apparent way. It do^es not serve the beginner well 
as a* reference because its use requires an i^;(derstand ine of 
the System . 'The *syntax for the command lanrcuage is^comolex 
(althpugh functlpnal and very effective for those' who have 
learned to use the /Svs t'em ) and. reauires that detailed 
explanatJ.on be available for reference. The command 
lans:uaee summary >Dr*ovided at training time wa's too cryptic 
to sisrve this puroose. v . ^ - 

• " -t • ' - 

An introductory, self-explanatory training manual was 
not .available . Perhaps the complexity and richness of AHI 
rendered it a formidable ta:§k. The stopgap, measure was to 
have ' capable w users stand by- in the /Ifamed iate vicinity to aid 
the struggling neophyte at. a momentS^not ice while an 
introductory command summary was written. 

Learninc: to use AHI was assigned a low prior ity -^when , 
the subject was under pre'ssure to ^get 'other jobs done. Of 
course, this could be an excuse that miR:ht' in fact not be. 
the aciual .cause.' Admittedly, it is a- real -nuisan^ce to °' 
chancre the tools for doin»g one's jQb and learn a new skitl ^ 
/>in the middle of things. .\ • 

^ However, after-^a^t'rial^ oerio^ ofi approximately one 

monQh^ iji was concls^ded in^ li^^ht ^o-f, these problems that a :„ 
poldicy . regard ing use^shoulb be es1:,ab.l ished by manac^^emen t\ 
The '^decision to require use was made.^in light bf the:;^^ 
hypothesis that any work that can be hand writieYi can be , 
done on the System* with <;fe^ exception o*f that reauiring 
special alohanumer ips . TFTis was based on the ^oll^owing 
assumptions. - „ ' 1 

(1) Isf the System^ is only used , occasionally , i.e. a 
counle of nimes a week", tben "the .le^yel of proficiency 
necesjsary tip mak^e^^the Syste^ truly ^^n imorbvemenlb will' never 
be .attained. Practice* throUcrh regular, -use i3 jDPcessary . 

• :<2)~ If'new users are instructed to use the System for 
all^^ossible knowledge work, then we can det^ermine what work 
;is not aporc^oria t^e for AHI by observation. ' / 

^ ^'(3) The ^System of fe'Ts alternatives to habitual ways of 
communicating in wriNtten form. New . users will naturally be 
reluctant to use the System unless strongly encouraged. 
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The renuir.ement \^as e^orced by in'structin? the 
secretarie^Xof the population^ not to accept any handwrittenf 
drafts for fVpin^? unless 4li.^_..£2LS^Pt io^^ was soedifically 
authorized by their supervIsorT^Wo>^ that necessitated the . 
supervisor' s review and coordination v^ould oilly be. reviewed 
throu{?h AHI (drafts are printed out for transmission' - " 
elsewhere),. It was expected that there would be an initial 
dlroD in work cutout until some Aevel of proficienc^y was 
reached , est imated to be about one month. A little friendly 
persuasion seemed approoriate to ov»ercome initial problems 
— "Try it, 'you'll like i€" . . ^ 

The reauirement met with definite net^ative reactions of 
an emotional nature even thou^^h all persons involved were 
G^iven at least a month, and in some cases up to four .months , 
to^ voluntar ilj^* use AHJ, for whgt.e\rer they wished. They were 
encouracced to use it jTor a status report to their imraediate 
manacrer, himsel fva^-^fser . A secretary was employed to ^ter . 
into the System- apy written work that had already beenr 
completed. Which then would be available for updating, etc. 
This arlso met with resistance. . ' ' 

^ Individuals manifested a range of behaviors,^ from 
tryinec to ignore the whole thiner to actively campaignincc 
against it. Some of those who. tried became distressed when 

^System oroblems were encountered. Indeed, initial System- 
oer fo-rman*Ge> d id leave a ^lot to be desired In depend ab ility, 
but it was not much different from any experiraentaL computer 
facility.' The reactions ^geemed to correlate with the 
observer's asseesm-ent of personality type. Those who seemed, 
to be closed minted, were the most threatened^by required use 
(this was examined more objectively throuccft the use of test 
instruments see Section IV). AIS9 , those manifesting a^ 
high'-'ej^o involvement wjUh their work reacted more negatively 
than did others. ' \ ■ ^ 

Factors other than personal ity and demographic 
attributes were r^atively consistent. Equipment and 
training had been' available forabout four months. Everyone 
had been exposed to . the System, either through' Glasses or by 
beinPT in the area where thp System i-s bein^ bsed\. j^Ae^e of 
the Dotehtial * user did not* seem to be a factor affecting 

' motivation to begin the task o;f lea,r^/ingf neither did. 
experience wi tb canfPuters , or job taik; t ype . - The variable 
was one that is most obvious and generally true of any new 

' tool-- aggressiveness ( generic^ use ) . Mrie least ag«^ressi^e 
subjects initially ignored the, System. , As the more 
inhibited persons saw their colleag.ues becoming 'involved 
with AHI, they responded to the pressure., to .become >eal 
AKWs . ' , ' \ , ' ^ 

Balr: AKW Evaluation.. - ^' Page 30 



' Ec;o tt\reat ^as identi f ied' on basis, of verbal and 

non-verbal behaviors over a period p'^f sevferal months. When, 
questioned about their work a sub jec.t 's defensive'ness Was 
noted by facial flushing', elusive, or a-ggressive statements,, 
or PeverS'e attack where the subje(3t- would say, "if I \/ad 
•nothint^ .^else to do like you, I*d learn it....'" 'Complaining 
within earshot Of * the obseyrv.er 'usually ..centered, around now" 
busy ahd how iraport'ant i^ was^ ''tl^at ^he not:'be imposed y^p^n . 
These are examples of very impres.slpnist ic observations; 
however, they do offer some in'sight . ^ 

Interviews' with two .'subjects who ^ we re System 
propcrammers ' ^reveal e'd -thafr^hey were , not able, in their 
judgment, to use the . Syst'elKfor a long report. The joint 
effort was to be' oubilshed ,^nd the primary reason for pot 
using AH I was ^a lack of time'^ to ccain^ the i^roficiency 
necessary . \ • " 

' A* ^ 

Morg speciific reasons were given that reflect upon 'the 
difficulty of ^gaining that proficiency-^and the limitations 
of the teletype on-i^ted TNLS V(as opposed to the -display 
version of AHI^ DN^LS, . which is discussed in Section V>. The 
. inf ormatiorv-was 'not visible eJiough\for maintenance- of'the . 
train, of thought . Some subjects felt that they .could not 
see "previous/pages or the context of the current locatio^of 
the polnCer .( the positicJn in the text where any editing^ 
'Commands w'ill . take effect) easily enoug,h. (It requires that 
enough text be printed, for •'the user .to identify it in * \ 
relation to the document). Addressing was not "natural" 
enough: Inadequate trainlng-jms proixably a significant ' 



of *a printer for quality 
and improved the situation 
vis'a^ility, after the fact.. 

discuss the problems 



factor here The installatio-n 
hardcopy output encouraged use 
considerably by providing some 

It wouSd be misleading to 
exper^ie-nced jDy the trainees without mentioning /the trainers 
TeacKing the use of such 'a complex system is difficult under 
any circumstances,, and in thislcase it was the first attempt 
by those ipdividuals ^who were responsible. They had some 
help from 'the staff „a* SRI(ARC) but this was^limited for a 
num.ber of good reasons. Thus , ^hey"- were on their own 
learning about - learn ing and th^ Sys.tem at the same -.tlmje . 
Therms 4oes not seem "60 be much point in trying to asse^as; the 
influe^nc^ of teaching personnel ahd method, but it can Ibe 
concTuc^ed that experienced and moVe skilled' teachers - woVld . 
have lessened some of the problems encountered. --^ 



briefly,, initial instructio^n was done, in siji^ll groups..^ 
B^ch pi^rson j^as giV.en A terminal so that 'he could do the 
crQeration as!' it was described by th^ instructor . " The l/Tg-in 
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operation, e^nterine; thfe ^appropriate ^uasyst em., status • 
listinc:s, error messages, etc'. , wer^covered in the order. »^ 
they would, normally>'be used.' AfteVJjxat operations were ✓ 
described in the, order ot use^uln^ess , . a function df usacje 
frequency Si fVer two or^ three dayjs of thiW the trainees 
.were told to practice, ^while the instructors stoo^by to c:ive 
^assistance. In t^e ?\^tKST^^ a concept ual cr^erv iew ofl the 
System would probably |helD prior to any attempted usac^e^. - 

The difference between on-line composition and use as . 
an automatic tyoewriter became an important factor ^ as hew • 
users proghes>€Ldk This d if fjerentiation was- remarkably 
discrete as evidencecj by the work methods^ ^^moloye'cl . 



On-^llne composition "was tlje modus .operandi with the 
first fev7* person.s to .learn (who had been "on" the System'Tor 
oveKa year)., It is characterized by little use of papgr, ' 
eithqr for the original composition of new idea^ or for^^the 
broofreading of drafted p^^ers. Instdad, all struct urinl^^rj^ 
outlining, wording and phrasing, etc . , is dfe^pe wh ile '^^•^ 
on-line. . / ' / ^ /f^' 



Use as an^ automat^lc typewrit^er is characterized by 
handwriting outlines and original drafts often creating a 
complete draft th^t .is typed into the System by a secretary. 
A Printout is, then used for proofreading and rpvisihg which 
are done on the printout it sel f. .These are then entered 
into Wie System on-lirie. .^Further reviewincr is don-e .in a 
similar manner. There is no effort to enter ideas directly 
usiner 'an on-line terminal.. There may be nuifierous reasons 
for this, >not the. least of which is "the noA-aVailability of 
a CRT display or inability to use* the dls/lay version of 
AHl. As m«entioned above typing skill is another 1 imiting 
factor, although . those who_have used the System for on-line. 
comPTOition have found^. that a typing ability evolves 
naturallv . • - . 

/''The Dsycholog'^' of Ithe situation also played an 
impprtc^nt role. ' Certain subjects expressed a reluctance to 
use a >eletvpe\ b^ebause, typing was beneath them. Comments, 
suchy^s, "what ivfili. the se\cretaries do," or "I wasn^^t hired 
.as a *typist',"/'0Yc .,• were noted . The reasons are not clear; 
however. Why tf\^risitioal from automatic tyoewriter usr6 to' 

at ion apoears to ' be^ an important threshold 
b^e c o an A KW 



\inteliec t ;^^gfne 
in the pro(iess 



4' 



Continuing usag^ <|^n a;^da/\p day basis ,be<?ins to^make 
the S/stem transparent, which is^^obabl y iiecessary 'for * tl^^ 
transition to on-line 6omposition\and intellect augmentation 
ln \general'. The. command, language ,\addre'ssirig\ viewing . 
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©Derating the, terminal, and the other mechanisms necessary 
for us^i-ore become o.f less concern, freeing the individual to 
'deal' directly with the subject matter at hand. None'Qf the 
population has .experienced total System transparency, but a 
Tew have corae close. They are limited somewhat tfy technical 
difficulties such as computer crashes. . ■ " 

Observations, of true AKWs at* SRI aVe evidence that a 
transparency can be achieved, at. least for a lar<?e 
peroentaq:fe of the.kindi of work done. Those observed had 
been on .the* -System for a numbfer of years leading us to 
believe that, full capability may take years. This' is, of 
\course, a function of what the -user, selects to do on-line 
little used facilities',, such as other ARPA networlj resources 
residin<^ on other comfPUterfe, would be less transparent. 

Transparency is a*lso characteristic of the rules of the 
spontaneous use of I'aneua^e, as^. in conversational spfeech. 
Th^e e^cperience and ^rp^Tess of learning to use AHI is • . 
analOf^ous to the acquisition of natural lanccuai^e and rerrfinds 
one of the work of the npted' psychologist , Jean Piac:et^'' 
There is a defin ite' syntaix applied to the -vocabulary that 
enables the person to combine command words to perform "novel 
operations, thus -genera tin new and acceptable pattern>s of/ 
lane:ua^e. These in* turn f ac il itate. d if feren t procedures and 
sequences of operations by tWe .procrpams. It is quite 
obvious at the outset that trtere ar^ many different ways to 
do the same thincr. This nermits a personal "style", to. 
evolve for e'ach individual that is supposedly most effective 
for him (see. Section V, -Proficiencv Test). ' ■ ' 

p As with natural lans:uaf^e, a subliminal. knowled<?e of the 
basic r^ulfes is used to s:enerate new command "sentences" fro-hi 
the <iiv9tr\ vocabulary that* the computer will recognize. The 
subliminal ^ attV^ibute is closely* related to the transparency 
.disG^ussed , above. We *can speculate that a pervson's ability 
to e:feneralize froifn-the command listincrs will be -a /dec is iye 
factor in his successful utilization of the System, 
especially as a tool for crea tive ef f^ts Once he becomes 
■^fCfSpt at "speakinj; the^System's lan^uaqe", dif^ferent 
reactions are 'observable while dependency upon the System' 
increases . ^ ^ ^ 

Effects on the Individual 

, A pressure on the user to work at a hi'^^h capacity while 

on-line was one of the most prominent experiences observed.', 

A <yreat deal- of involvement opcnrs ^ especially when the user 
is on a display terminal. 
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One causal factor may be the automatic logout if 
nothini? is done for about fifteen minutes, resultincc in some 
anxiety whenever one is distracted. This is not sufficient 
cause for things such as an extraordinary reluctance to 
engage any oei^son who wishes to interrupt an AKW. Another 
Dossiblility is limited System availability due to 'Jdowjn 
time" and hardware "bugs". An .available System, functioning 
* reliably and rapidly is a strong incentive to "use it while 
you can". These factors ^re influential, but the reasons 
?iDDear to be more D'^ofound. 

, The act of creating something that will be highly 
*yTT^i^» not permanent or rigid, is very attractive, albeit 
subliminallv. A Person experiences a freedom and release 
from the respSVisitxil ity of having to live with some document 
that is set in ink. It is '^analogous to thinking through 
ideas and- structuring a draft mentally. It can be, altered 
in almost any wav at any time, thiis facilitating creative 
experimentation. 

Not only is therms an increase in 'the freedom to be 
creative with content, but there tends to be an uninhibited 
work rate, limited only by the Dresent hard"w9re devices. If 
a writer is aware that he will have to alter or retype his 
Daper if he makes an error or forgets an idea, the rate at' 
which he proceeds must necessarily be restrained. This is, 
true even when a draft is handwritten. There is a limit t6 
the amount^of revision that can be dope-between the lines, ^ 
if laeibility does not^ suffer, then one simDly runs out^of' 
paper. There have been numerous instances of revision where 
there would not have been without the System. 

A new, user may have to learn to be less inhibited about 
rendering his ideas visible at an earlier stage of ^ 
development than would be the case ordinarily. Perhaps more 
ifnportant^ is that he feels free to change and* remould 
whatever "dumped" into the System. There has 
traditionai^<y been a lot of negative reinforcement^ ^ 
associated With chang ing written matter, even if it is only' 
a personal working document, which AHI minimizes . 

AHI appears to provide unprecedented flexibility and 
freedom with textual information for the individual; This 
is dependent ' upon the joint use of the display CDNLS) and 
the teletype versions of the on-line System. In this 
discussion, observations include both types of terminals. 

The 'qlternate use of the 'tw6 terminals is desirable ' 
Dartinularly durins; thg on-line coFn,position of a lenc^thy 
report. Brieflv, the^teletype. is. best for, typing in 
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seouences of text — a hardcooy is T)roduced, and it is easy 
to keep track of the current position relative to the 
precedine; text. The DNLS display, on the other hand, does 
not show more than one pa^e at a time, and shows the 
statement currently beintr entered at the too of the screen 
while Dreceedinct statements rjiay not be visible. However, it 
is far more powerful for editing text changes are 
actuated by merely pointing to the desired location on a 
pas^e. Restr uctur ins; is c^reatly facilitated by the 
capability to chani?e views rapidly. (This' will be discussed 
furthe-r 'in the section on display effects.) 

It is int erest ing ' to note that free^oAm and flexibility 
,seem to reqtSire structure, rather than bel'ng inconsistent or 
contradictory with. structure . The ability to position ideas 
sj^ that their relative importance is clearly shown, to 
control what l^e^l of detail one is viewinc^, to show trees 
o^ relations-, i^s^esTucial to the flexibility gained by AHI. 
Jhe .utility- of the a^d4ressinG? .struct ure Vh^r 
various information unrt^a^ etc . , is illusVr^f^ by the 
tendency of j^he AHI lan^u^^<5^ to "creep in to /tl^^ everyday . 
la.n<3!:u^£Te O'f^ AKW's. For exarrr^i^. "Well , 'expunge' thatl Jlle 
or\ Melete olex 1^, it was reiec^'^ " 

freedom a^ni flexibility are not limited to individ^aal 
usacre of AHI., t^ut 'a(*e extended to sjroups /^^^l^ms , and the 
orc^an izat ie^ri thro-ueh. the interpersonal coinmimi<j!at ion 
f acil ities . ' _ \ ' 

Use of the Communication Facilities 

There are two spec if ic sub-systems, f or on-line 
communication (part of the [tENEX Executive softw^^re) and an 
extensive communication capability as part of the " Journal" , 
.a subset of the Dixie's: Supoort ^3ystem. 

"Send Messaore" permits message trartsftiission by entering 
a literal and the "names of any number of rec ipien ts a-t any 
node on the A-RPA Network rectardless of t^eoera^phical location 
or use of AHI. The messae;'e, is automatically sent to each 
user notine; "copies to (username)", subject, and title. 
Notifio^ition of the recipient occurs, with' "you have a 
messa^re" upon initial System loc^-in . 

The "Link" command ties tb^ether two (or more) 
terminals so that messages may be transferred or oneo user 
ma^ cbserve while the other works. "Advise" may be invokred 



enab: 



inc: one user to work on \he other's files thus 



f acii it?fting a shared control over the ed it ing , v iewin^ , . 
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etc. This is ^the basis for on-line conferencinj; and is most 
useful in the display version of AHI with a supplemental* 
audio (ohone) link. - . _ 

The Journal System is a collection of tools .^nd 
Drocedures to manipulate documentation. Th user may 
essentially send .any on-line textual entity, a messa<?e, a 
letter, a document or a book, to any number of users in any 
format merely by specifying the initials (id's) of the^ 
recioients. ^Distribution, recordint?, orintinc^, mailinct, 
library filinc?; and indexinc? are handled completely 
autoAnatically with numerous options for the author. \^ 

These subsystems can be activated at any timB. Journal 
and Send Messac^e will deliver the item to a specified file 
(analogous to a. mailbox) beloncjinq to the receiver. Any 
amount of information may be so transmitted almost 
immediately for the recipient's perusal at his coriven ienc*e . 
A^ain, this speed and ease appear to encourage "mailinf?" 
information. ■ . 

We have f^und that the messag^e ' send in? ^ feature is 
analoftous to sendine memos and has aimilar fjharacter istics 
-;^>i^ease and convenience, although it tends to be less 
formal. It ia an important advantage^ that the .receiver^ does 
not have to be on-line at the time.. We are abie to retain 
copies of the me^^ssages when they ape^ printed out for reading 
or by inserting them intp- the appropriate ^Subsystem . 
However , 4they usually^afje not i^tained by the^ec ipien t . 



' Messae:es are^ransmitted more easily^ than memos in yhat 
they do not invorve paper jJrocessing, a secretary-'tvpist L or^ 
addressing and mailin<r. W^ have foundfthat. they are sent^ in 
situations where no written . communication would have been ^ 
used otherwise, resulting in an increase in communication^"' 
especially vertically within the organization. 

fit ^ • ■ 

*A manae^er who is usually difficult to reach due to 
meetinp'S and other preoccupations can be easily notified. 
AlthouG:h advantageous from this standpoint, messages arq 
easlejr to ignore due to the ten tativeness of the-computer - 
storage. A* memo or letter i^ a I'ittle more*demartding ^- 
oerhaps due to Its physical presence^ . , - 

The interviews of users have surf^ce'd an Important 
potential disadvantage. The use of the message System can 
tend to depersonalize communication or at lefest substitute 
for face-to-face interaction (see Section 5. "Communication 
Tally"). This is in lar^e part due to i1>s-^ase of use as an 
alternative or substitute for face-to-face comtnunicat ion as 



\ 
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was oredicted Turoff ( 1972). For ekample , ^ it nav be 
selected as the node of interaction because of a distasteful 
or negative content. The mactnitude' of the^problem is 
difficult to ascertain. If it is si«?nif icant , a negative, 
shift in attitude toward the System miqht occur; This was 

^not detected by the attitude >ieasures reported in Sections' 

^ IV and V. ^ . ^ 

Vc\e Journal Systen^. is being used ostensibly as a 
comouter based nailincc System for handlinipr wnitten 
communication of longer lengths. A hardcopy can literally 
be mailed but most of our users read their "mail" on-line ^ 
using the easily .executed retrieval commands. 



It also has a message send ing iijapabil ity where , ynHljfe 
the TENEX Send Message fe\ture, messag'es are permanently 
stored j indexed, cross* rens^epced , ahd catalogued. " This 
part of the Dialog ^ Support system which has a potential 
impact much . beyond that whicnVwe have ex'plored. 

With few exceptions, the pppulatio'n has not been using 
the Journal* fo;^ dialogue supooj7t. The Journal is perceived 
as. a place to, store items' of permanent value, which is* 
usually^ not felt to be the case" with messages. This may 
represent a" reluctance to ."store routine transactions it 
IS feared that they may return to "haunt" the originator. 



The lack of understanding pf the purposes and 
of the Journal mav be more significant. " Dialog^Stlp^r^rV!, is 
defiriitely. a clue that con tinuing interactions oflght be 
recorded much as are the minutes of meetinijSv^Not only does 
this orovide the commun icators with a histoid of 
transactions relevant ytTr"ireT*^£Llj 3 sub j ec t jyfetter , but it 
provides the using community with ah"^>e^^ht in to 
develonments that otherwise would have remained obscure. 

The Augmea^^ed Community based at SRI is facilitated by 
the dialogue record, as this pbpulatiion will probably be 
with additional experience. Links ] (^addresses that may be 
activated to losad the in formation, spec if ied ) are imbedded in 
subsequent ^-ialofesue records providing cross references to 
previous or relevaht transactions . Thus , an interested 
party may follow phe progression of transactions at SRI and 
Quickly erase the) "meat" of the issxie^.^^ 

The use of link address.es mav be supplemented by simply 
reading others' files. File read access and sharing has not 
been used'^'as extensively as expected (our people tend not to 
be nosy....) A few of ^th^ users h^ve perused others ' files 
to learn of their doings or to answer a pressing Question in" 
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eir absence. By and lart^e; however, this access is 
limited to copyinc? some information that was known " 
beforehand or respondincc to soecific. requests.. This will be 
described In the .oortion of this p^per dealinct with effects 
on the orccanization . 

LTnkinc? (note the entirely different use of the term) 
may, be compared Vo a teleohone conversation. The 
sic^nificant difference is that linkincr is m^ore convenient 
when a user is on-line. 

As mentioned above, when an AKW is on-line, tDther 
interactions are resisted and interr uot ions are d iscourac^ed . 
However, it does not seem -to constitute as much of an 
interruDtion to engaf^e^n dialoc^ue through the terminal^ 
The^ n^pvel^if*Df this means of interacting may have some- 
effecV onx^ts attractiveness. It is unique in our 
experi^>^S\^ It has the ten ta tivenesa o f oral commun icat ion , 
but lapKS the oaral in(?uist ic , .non-ver*b.al cues that would be 
transmitted vi4 the ohone. It has the immediate app'earance 
of bein^ a written communication ; however , it differs in ,^ 
' oermanence (there is no way to store the transaction except 
to retain the teletype paper), immediacy, spontaneity , and 
its' real time interactiveness. There is no time to oeruse 
the communication or deal with written text since the. 
recipient is reading if as it is being typed. This results 
in a ^stylistic difference which. re?auires, amo^g other ! 
things, an explicitness not inherent^in oral communication, 
e .> . humorous jesting has to be labeled^with a 'Tra*, ha" or^ 
something similar to ensure correct interpretation. * 

Linking hafe been used extensively as an inteccral part 
of the AHI System. It is important to note here that 
although neither Send Message nor Linking are uniaue to AHI'. 
(they are available on other . computer systems), usage*' 
appears to be dependent upon the design and purpose of the 
en tire System • If the System were not emoloyed tc 
accomplish the daily knowledere work of grouos, it is 
doubtful that either feature would have any Significant 
utilitv. Bpth features are available for immediate use if 
the AKW is on-line and the peed arises. ;We have linfced 
amonpy ourselves and with various users on the Network 
includincr our colleagues in Washington^ D.C., and the team 
at SRI. In imanv cases contact occurred where there 
otherwise would have beeri none, thus promoting teamwork. 

The^^^^feikinpt feature is bein? used within the teams for 
short, extemporaneous questions and comments. Sur pri^|,ngly',' 
Lirnking is utilized when AKWs are within close proximity in 

the same building, in ne ighborlng " rooms , or even within the 

/-» ■ . 
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same room. Novelty miojht play a part, in this , ^^ut usa^e 

emphasizes the ease and coavenience. It can concluded 

from our observations that, as wit-h Send Messac^e, » 

communications occurred where they would not have -otherwise 



Effects on Gro^ups and Teanfs- 

The System facilitated interaction withiri teams 
independent of c^eoftraphical location, Althauj;h this/^was 
ODtimistically predicted, thenrature of th^ teams i^ 
different tha*n expec;ted. The teams centered around common, 
oroblems, or at least tasks of mutual interest to the 
members. The novel outcqme was that people within the same 
orcranizational unit did not exhibit 'any increase in unity, 
or relate experiences that would indicate iruvreased grouo 
Identity. The subf^roups remained isolated from each other 
when the user population was expanded to the present size . 
(at the outset of organizational implementation ) « This was 
the case even when the subgroups were located in the same 
room, and it probably was related to the level of System 
usage within ^tbe respective groups.* 

System use as a-cdmmun ication medium on more than an 
occasional basis appeared to be a 'function of- the level of 
usa^e in general, subject personality', and the group 
dynamics. It is clear th^at these factbrs cannot be 
dissected: they are intertwined to a degree that would^ 
require analysis beyond the sc^pe of this st.udy.. ^the 
behaviors are shlient, however. ^ - , 

Those subjects who did not access the System on an 
almost daily basis showed little use of the communication^ 
facilities to in^teract wi.t,h peers,. The primary use was, as 
an automatic typewt^^er or text editor, and 'did najt , ^ " 
represent the addition of communication .channels. » 

■ ^ ' . ■• ^ ' . ' 

It is difficult -to con jecture about which comes first, 
a hicrh enoupch level of usage or apnro^priate individual 
characteristics, bvtt differenced between peer sub^rouos 
based oh ner sonal itv , oarticularly the Leader's, were 
closely related to System communication* activity . 



There were two subgroups within 'the use-r population 
aligned onrthe^basis of a specific technical area. One 
subgroup was tasTte4>..jvi th System implementation,: — development 
and consequently were more likely to use* it for ^ 
communication due to their hicrher level of 'involvement , the 
more serious way in which they perceived -the System > and the 
.subseauent heavy usage. The . development 'team aljgp needed to 
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interact with other AKWs at the ARC to solve problems and 
accomplish contract administf*at ion . Since these important 
functions of coordination, and joinf effort were more easily 
carried' out throucch the System," a strong -incentive existed 
for this subgrodp to use the "communication tools as opposed, 
to the other subJ^roup. ^ v"^ .: • 

»■ ■ ^ 

.Antother Cactar involved the/managers of €he two 
•sub^rouDs within tj'he user' population . By contrast , the. 
otherr- ccroun 1( whic'h^ experiencad much, lowj^r use levels) was 
more homocceneous ^*S^kccr(5>ind ^ location, and much m6re 
closely^ aligned with the;;;le^der . This case invplved • 
dif ferment manager.ial styles afc^ the -ai^b^roup^ leader level, 
dif-ferent histories, and different physical locat^-ons. 

/This' sub^^raup worked with their leader -who consistently 
represented them to hioiher manaccement. Jhey had more 
freaiient meetings and were physicalLy colocaied for most of 
the invest iccative. per iod . This was not totally a function 
of personal it ies , but resulted from the group's hisitory as 
well. The subs^rouo as an entity, was merged into the fltroup 
or "section" in -a reorganization * thajtx occurred some time, 
before this study. Thus, glnoj^t^^. fn^n^ijty ' and ^cohesiveness 
were* reinforced . " ' ' 



The AHI Group, as the development . subgroup ' was called, 
-wasl headed a much ^mo re laissez faire individual who had^ 
been transferT^'^tjk^nto the subeiroup immediately prior to /the 
t^slt period.' He was lopated jLn a separate room and wa^ 
tasked with learning: to use the System. . The former qubctroup 
leader remained within the subjscroup and retained his . 
Position, as contract monitor for the AHI project. The 'new 
leader was involved with social J^^latjjonsl^ based on. his ^ 
jrmet^ positions. The AHI s ub e; ro upmemb e r^ had quite varied 
rckg:rounds as well. - " 

, jAlthough the numerous and complexly related factors, 
lim'lt crenerali'zation , .there* are some important conclusions. 
Group structure has a strong impact on usage for 
commun i^ga^ion r The -personal ity of the leader becomes 
increasingly inroortant with stronger fitroup identity, whicl^ 
can be traced historically. The obvious prediction that the 
larger the rel&vant co^nrriun ity of a group using AHI, the more 
that communication will occur was demonstrated by the 
relative usage of* these two subgroups. 

Channe^ of communication that did open withinj,the 
or^^aniza tion were based on training requiremeats ahd usually 
consisted of help from the more experienced users to the 
neophytes,* Of course, the observer opened • channels in order 
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to Qiather- the reaxLtions of up-and-corning users. 'These 
spurious channels were certainly. not reoresen ta tive of 
improved cpmnun icat ion . 

Judgement jof this lack of increased interaction across 
task boundaries as an insufficient outcome is unfair. The 
task stn.ucture within the on^an izatibn d id not chans:e. 
Individuals and sub^rouDS continued to work on problems in 
seoarate. areas of specialization thus minimizinc; the neeTT 
for horizont^l'^communicat ion . ^ - - 

It is encouracrins; that the consistency and amount of 
communication withi/n a oriori clusters of AKWs noticeably 
increased, isspec iall v. the vertical channels, which will be 
discussed in a separate section. The Journal was the 
primarv vehicle for sendin>cc messages, documents, interesting 
articles and/^^-referenc^s , plan-s and* proc^rams , copies of 
d"orresDondence for non-AKWs, minutes and agendas of J 
meetings, etc. Where /these written communications mittfii 
Have occurrd on a chance basis before, they were duly sent 
to the poncerned team members^nd stored for usage through 
the Journal 

Team collaboratipn was very evident when an individual 
was in need of ^dditio^al resources outside his own 
"information space". During the preparation of briefings, 
and parsers on relate/j 'topics, individuals drew directly upon 
the work of. colleagues by either usinst their files in the 
brieting or by moving the appropriate information directly 
into their in^^ormation space. 

An exemplary transaction involved the develoDment of a 
Technical Planning .Objective' intended for several levels up 
in the management hierarchy. The responsible writer 
G-enerated a draft of the document covering all areas even 
though some individuals were not presen t. ' Then , via Send 
Message, he notified those^ people to examine the document 
for cofnments^^md revise their oartLcul^r portion. They 
simoly coniid it( into their working s_pace , rewrote as 
appronria^^l/knd rTTTN/ed the f in i shed product back^into the 
master do(5^^ent. 

The most extraord iriary channel s opened were those with 
SRI, j^ontinent away. Concerned individuals were able to 
tijollaoo^afce on oapers for conferences , ^proposals for 
f und inf^ ,^^nd the necessary support of .AHI users. 

One case' involved higher management at, RADC (the 
division level) which reauested a paper be submitted fo^r a 
conference within a deadline of a few days. Conseauen tly , 
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the oaper was coordinated, formats and content as^reed upon, 
and a final ©opy printed in the mana<3:er*s office, on time in 
spite of the mails. * 

' ■ 

A similar Situation was initiated ' by the California / 
based AKWs. An annual technical report by SRI(ARC) inclines 
a discussion the pro8;ress of the work on?oin«? at remotK 
user cites incl udin^' the cite where this study was took 
place. A draft of the report was made available via the 
on-line sharino; of files , and the ^ comments of the user cite 
were sent through the communication facilitie3 of the 
system'. SRI then re-examined it, the process continuing? 
until it satisfied both parties. The ease, with which 
revisions are made with real time interaction, not involvin<^ 
the preparation and mailinc? of written documentation,, is 
quite apparent with these important, lengthy papers . 

" Perhaps there *d^ll be increased communication between 
subgroups with more xtme and ne^ to interact .with others 
who are ^ "on" the System — a/larVer community. For the 
present, however, satisfying; teamwork , (teams exist across 
ccrdup and srcubo;ro.up boundaries) on a given task is 
facilitated by the ease and timeliness of AHI. 

Organizational Effect: 
- > Chans:es in' Vertical Communication 



Predicted problems 

The problems that were antic ipated are ,dT^cussed here x^"^ 
to alert the reader to the cuing which n^ay have biased our J \ 
^observations. It was predicted that mans^ers Vould be / / . ^ 
hesita^Qt to access the t^rking files of tW;^, subordin.at4§/ 
because of a kind of psychological anxiety ab^t discovering 
something they should not see, and the potential overload of 
detail and sheer volume of information. ' • 

Managers above the immediate ^supervisor (^.Iready an 
A KW) would be reluctant 'to acquire' the necessary skills 
because of the interruption of their tight schedule, the 
• , ease witA which they can ^ssigft jobs, to others, the nuisanc 
of ^sittihi down' at a terminal ,c^specially with' the nujnerous 
routing interrupt ions , and the..fVi>ly habityated mode of 
sol vine pr 6.^1 ems throus:h conversation (see Con rath , 1973) • 

EnprineeV.s at ' the "worker" level would experience some 




nuisance 



in^terr uptions , and the.«f?ui^ly 
pr 6.^1 ems throus:h conversation 



.reluctance to^enter fil^ into\the Syatem wh-ere they might 

'i • /' ' ■ 

\ ■ , • 
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be perused by a manas:er/prematurel^. 
controls woufd be used reluqtantly 



The file access 



These DredictioiJs center around the ilroblem of changinp; 
stronfrlv iriccrained wo»^J< Habits. *Th|ere are numerous 
add;ltional qred ictions^ which could- ])e made; however, this 
should adeauately * ind icate the expectations crener^ted * by 



experience yo date 



Trad itional'lP&'ttern^ o f prt?aniz^t ional Communication 

The patterns of communication before AHI were typical 
of any lar^^e buf ine-^ , or ""indust ry wriere the majority^of 
Deonle are stfi^ntif fc/pnofessional . jThe patterns were « 
dependent larojel v uDo'n ' the formal^ qijjihority structure and 
the task assifyjimente . >^ I . .V 

A "section"'consisted of about oersons suoervised by 
a "section chi^" who represented th0 first of fioial' level 
of manacrement V ' A »iP,seudo manacr^erv^nt level between the 
section chief "ahrJ-' the "worker bee'' , was called the ejroup 
level, and vas based on a 'spec rflc System' develoom'ent 
activitty which was ^he primary function of ^h-at ejroup as 
(;jis'cussed earlier. 

The section chief in this pooulation manaered in an easy 
^Toinc: way 'where the orimary means of direction, were throuq:h 
scheduled meet in«3:s ( rare ) , chance meet in.^s , and d'irect 
contact. Few, if any, memos were ever used.. Return 
communication to the manaf^er was throue;h the sam^ means with 
the addition of oeriodic required status reoorts. An qoe^n 
door Dolicy (and first name iri formal ity ) were the norm. 
Thus, a loosely knit structure existed at. this level where 
much of the, vertical interaction was by default. ' ' 
Directives — requirements which came down. from higher levels" 
were usually nassed on by word ojf mouth. 



New natterns . ' ' \ 

The most noticeable ohancte r(^ultin<^ from System \ 
implementation was the extensive use of Send Messas:e. TThe 
section chief has been usin^ this capability to schedule 
meetincrs, resnond to - quest ions , 'and make request s . M^ssaeie 
traffic has-been heavy and effective, even at ear^^-^^^^^ 
of its useV The most important usac^e has been to. contSct 
subord inate^ho is not available at the time in an inf^rmi 
"banner without the necessity of written records. Thus 
overhead in resources is 
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Sc,enarios of \sit ua^|t;.'ions in which the messai^b feature 
^ha's beeh us.ed to* aldvafit^j?e . are numerous ih th^ chronicle . 

'icial yerltioal^.y^ ar4 ocdurr^ng, where 

mid^hVnoV have been\\ p6ssilile.' • \ •/ ^ * ' 

Fori examV)le,; thj^ thtVd level manager ' wAs5 able to work 
directlVi with \he ^(irst level m^^^^ sWction chief, in 

obtajininqr a eiu^st stoeaker W a professional Conference. In - 
this case the s^conq^ level \was hot -involved a? he would have 
been thrdiurrh the\trad itionai chain of command.X Arranctemen ts 
for p:uestW/ etc were, made \in .the same manner\ 

Th6,' System enables messa^e.si of an informative nature, 
not reauXrln^ action, but incVeaisin^^v the effectiveness of 
the recioX^nt , to h^ef-sent dirdctXy to him without " th? ' 
usuallv orbhibitive problems.. v ' • --v 

\ ^ • ' . • * ■ -'^ ^ . ■ ' 

The Journal System has . be^V apP^^o^^^i^^^ document 
coordination through the "chain p;f command".^ It has been 
relecrated to more formal ^ocuifrents in most^pases. The major 
power has been idealized when lericsthy docum^en ts . must b.e 
revised numerous times to isatisfy manas^ers. 

A recent plan to orocure / add it iohal terminals is a case' 
in" Doint. Over a pe-riod of^ sevenrwor^in^ ciaYs , a plan was 
prepared and rejected as- " too all encompassinxc" It was 
orenared apcain and met uoon . Lt^ wd^ revised as a result of 
the isjeetinf?: . A tertiary revision" 'was made a-s a result of 
the'' minutes, of the meeting, and 'submitted tb ^the Division \ 
Chief in finished form. ' V ^ 

. Another instance involved the- creation of special 
workinc? documeYitation , which has been created far imanagem.ent' 
to- orovide an up-to-date description of research and 
deveiooment "efforts". These were prepared ^ b}{ th.e ^ ^ 
individua-l in chareie and cduld have reoresertted a » 
procurement, particular invest is:ation or <:Jevelopmen t 
actxvitv . « ' ' ' . . 

The ^roc^^dure utilizes" the editing power of ' AHI between 
user's' djBectories. . A standard format is copied ^by the 
individual who -then "fills in" his information. Previously, 
any such periodic (monthly) and lengthy Paperwork would have 

. to be retvoed completely after updating even though' muclf^f 
the actual vert^iacce ^remained the. same. Now, .revisions aVe 
entered on-lipe and the fin ished oroduct is 'sen t to the 

^manarrer through the Journal alon<?, with a hardcopy orintout 
for BackuD. A marked increase, in the pr.omptneas with which 
this kind of job is completed '^3ttest s to AHI ' s 
ef fefctiveness . - 
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Wis is r,n especially ^ood exam'^^ld of in formation 
availability to au^^imented ^manacrers ; The on-line effort 
descriotion nay be. read at any t tme ,^ whather the or Ic^inaLtor 
is available or not^ iricludine; the latest updates. "What^s 
pcoincr on", a question so o'ften asked by mana^^erS; is easily 
and qtiickly answered by procedures such as this. ' . 

• ■ • s - • . 

Trio reoorts, a standard government for^n^ are also 
handled in this way. Ava ila^:) il ity to tean members and othef* 
interest ed ' colleac^ues is an added advantac^e -esDec^ially for 
establishing contacts. ' 

_ > * ■ . 

\ . ^ "Minutes of meetings',^ whether held loca^lly or on- a 
' bus iness; t,r ip , are entered in a commonly labeled file in 
* each user's dip^ectory^ The standard format againv provides 
an easy^way of ^mptoyinp: - a <^ommon structure to prepare 
d'ocunentat ipn for management. The Journal's library 
capability ia deoended upon to cataXog and store :yidex 
^"■tTitat ions to these documents; thus support ing the filins: as 
well as vertical communication activities. 

^ * Vertical communication has! alsa been fae il itated 
t^hrough the sharing ^of special , V'oDe'n" 'file^.'' "Open" refers 
to files tWat have beefi crea^te>l v;^itn rej^d and write" 
y oermission for the organ izational 

. A file called "Staffmeet" is Qsed by^th-e-H=fetvU>9n cJ:iief 
■ to record items of interest to. his subordinates by 
membershio ' in oWe of the two task groups. Occasionally, 
items- are entered that are' for one or two individuals.' The 
file is continually updated (weekly, as a minimum) and may 
be reviewed at any* time. The real value is ' the opportun i'ty 
for tlj^ jBubord inates to add comments , answer Questions, or 
add Ms-fee^^ of general interest at any time. The file has 
jbecome a supervisor * s nee.tinp- in absentia, and is retained 
* a s a record of the continuing dialk^gu^. ThlcS file seems to 
have become a highlv efficient mean3 of conc^uctin? the 
business of the organizational unit. '^f^-- v / 

Another file j-s \ised ^to record, for management, ariy 
^ news itenis for ootential inclusion in an administrative . 
newsbri>ef. Imagination is the limit where ooen file usage, 
is concerned. It is not olea^*^ why tbis channel is so 
g.ttractive, but its use,, in addition to the more formalized 
oonmunication ^features , provides a cQmplete vertical 
communicat ion - tool . . ^ ^ 

To this point ,we have been discussing experiences 
recrardless of terminal type. It is most /l ikel y th^t a 
display .terminal would not aporeciably change communication^ 
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usaee,., but it is certain that it does affect individual 
oerformance as- borne, out by the subjects that have ^becom^ 
oroficiei5it . . ^ / 



The Display On-line Sys tem^,\|^sus the TBletyDe 

The Displav On~litie Sygtem (DNLS) const i tutes * a 

'separate subsystem of AHI. it includes human "^en<ine^red" 

devices that^^result ih maximum ease (Iwithin the state-of-the 

art) of maD-eom'Puter communication;' 1 

' . ^/-^ ^ ' -J ' ' ^ ^ ' 

A h,^nd held, cursojr control transducer, the "mouse, , 

enables an AKW to vainj/ to, any textual entity on the TV like 

display/ He then can /perform any of t'he operations .tjbat^j,: 

were Svailabl-e in the/teletype vers|bon without fur^thdp ' . 

addressing. - Any^^^^^d^ixlne or other chaniyes are immediately • ' 

visible>^T© suWlem^ent the standard term tnal - keyboard , a' 

"binarv key^ejy^' may be used to key-in alphanunierics much aa 

one Vould^ pl'av chords on a pl9.no.. * ^ * ' s 

The. screen shoWs;.a nufnber of feedback "windows" for 
comma-nds*,' addresses , yieVfspecif ications litergl,^ inputs',. ; 
etc., in addition to tPie diapX^y ofv an^pproxija^'te pa^e'of a . 
textual file 1, Commands that c^^d in t , ^ delete ,^^2f6d execute are 4 
.actuated by l3;ut,tbns on the md^ste (see Encrerbart, 1968). ^. . 

This brie'f description of *the .highly interactive and ■ 
ODtimized interface will hopefully es.tablisfi ^the settinc^, for . 
the particular effects of DNLS^ It is thr6uQ:h *DNLS, it can^^ 
safeTy be sa^d , that the full potent ial for individual* 
augmentation can be realized. *iJuGh*" of tine fpregoine 
discussi<3n, mi^ht be revised to show more positive * 
ramifications if every . us.er had a display- terminal . . It is 
h^oed/that the additional*' effect and oanabilities ^ 
expe^iencea* .beyond ; the teletype usage will be established 
here * '* . ' \ 

' No oiae has^tried to- learn DNLS jrtfithout first becoming 
reasonablv cjapable' with the teleLyne. - The experience of 
those who' have learne-d^ bo\^ indicates thsf't.it would be 
difficult to start ?^ith al/ 

this. -The preS.ent n6st of tl^e-^isolay terminal .{$ 1 5 , 000 per 
IMLAC wrth mouse X^kevset) has encouraged the emnhasis of 
teletvoe access:, for the .time being . . ' 



One sub;i^ct», who has 'been usinjL^NLS for about 6 
months, desor^ibps the effect audte* vividly as [a "trip" that 
is addictive . • 
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. When DNLS 1/s flvin^ so am i! This causes a noticeable 
change in ;ny behavior^. I am. extremely reluctant to 
break for/lurvch, social conversation, eoffee', the 
5?00PM whistle or weekends. I smoke more 
*( unconsQiously ) . This is makiricr a*n emaciated, 
oonstioated^ emphysematous in trovert ; Who is 
nerrleo^tin^ his familv. 

• ./'•- ' • 

. He puffers the followine; analysis usine: some learnitic^ 

theory concents. He' states that the use of DNLS is. 

self — reinforcing because it is immediate, happens o ftejn , 

and ha^pnens at the level at which the behavior occurs'. Less 

freoui^nt, hut perhaos more oowerf ul reinf oVcmen t is obtained 

fron> coworkers — ^ "Ohr I didn't know you 'could do that!*' — 

which ^ives one a feelincr of bein? on top, of th.inp:js, 

-oae-uD-man-ship , superiority, etc.; and it is obtaineij. from 

bosses :in a similar way. In addition, the ability to '. 

rfispond auickly, often hefpre the Question is asked, 

ene:enders admiraticyfl. Mv personal exneriertce has been very 

siniljgfr- to thege oerc^eotive responses from this .member of 

the populaton. ' ' ■ ^ ' • 

The increased speech with which one can address chanc:e 
text, and actually see the change, results in a dramatic 
exnerience for the skilled user (there are three in our 
DoDulatiori). Pointing to a link address not only/displays* 
the addressed information at the push of a button, but also 
controls, the viewspecifjLcation or "wlnflov/" throuejh which one 
looks.^j^t a body of information. ^ 

^ Link addresses are" entered as any other- text . .Thus , 
the 'AKW typically enters links as he develops informSTion 
units- which are then linlced together (cross referenced) 
ineludinpr' the^^ specified .yiews of the information. For 
example, the \}se,r, may need to refer to an outline of the ^ 
document he is massa<?ine:. By actuat ih^ * the link he ma-y 
disD.lay' a tdolevel V iew; The System stores ud to five" views 
i5t*a^time which may be auickly recalled as needed, thus 
fap il itatinp; ' return to fhe detail and location where' the AKW 
was drlein^lly wflrkine-. - 

- In the sa'^e- m^anner he Cjan refer to any infprmation *unit 
for reference , which include-S thg %ast Journal ^ 
documentation . Or , he pan "snlit^* )the screen into a maximum 
of four -parts each reoresent ine: 9 window — textual units 
can 'be, -moved around between thes^. Searohinp; for a tooic 
area ' ts^ easily done by sirccessivel v. showine: more *lev els and 
detail "in ^ny oartioular file. | - 

Dlsplayincr ^various win-dows that look 'into the 
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informatian space is aoproDriate for briefings, et^.*, as 
visual aids: dynaTiio, comouter generated " vieworraphs" . The 
oower is in mbvine auickv./orward or backward thrduVtJj the 
aids, and nakinr? chanties at the reauest of the audienfee. 
Mov-'^nento is done bv imbedding a hidden, link to the next 
viewr^r^^ph/disDlaVi ^ * , 

A coTtole-te description would continue, but; i;Lt ' defies 
reasonable breyitv. Overall, it j.3 as if the AKW .were 
travelinor through information space conprised of the work of 
comnunities o,f AKWs. At any point he can stop and utilize 
the information at that location or move it tp-hisown 
information space from others.* . " 

One of the few notable limitations we have -^encountered 
is display recreate soeed, which is a function' of our 
terminals , -transmission line rate , and System load^: Everi 
under slow conditions, a "oac^e"' is written on the screen in 
a few seco^nds . Improvements in computer hardware .will 
probablv remove even these few secohds.^ ' / 

♦ This description is offered inlspite of the anticipated 
comments about over-enthusiasm and starry -eves . .rHow fast an 
AKW^'can "travel" through information space is surely a- 
function of.the individ-ual and the nature of the task. 
Conclusions from these observations^^ must be t^mt>ered due to 
the limited oooulatlon size. However, these are in fact 
experiences we have had to date. 



PoDulation Characteristics and Effecrt 
*• . - « 

It was difficult -to .separate the influence of the JoB 
^task tvoe variable from^.tfie personality variable, but some 
interest Infic ^experiences were observed'. * Those who spent ^he 
majoritv of their time orocsramminiJt mi^ht actually have been 
impeded in 'the learninc; of AHI because of proactive - 
in ter feren'be . Exoec ta t i^ns due to experiences , with other 
svstems inter fered rwith at least one of the subjects as he 
tried to use 'AHI. ^The joh task type profile is provided in 
Appendix A to aid the reader in the assessment of the 
results . ■ I 



Summary 

/ ' -,There was a stront? resistance to fchantr ini? habitual work 
methods and comnunicat ion patte»^ns. There were, 
nsvoholoc^ical as w^ll as hardware causes^ for the resistance,, 
which were mutuallv escala^inff. Weak tralnincr techniques^ 
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System failiires, and hardware una\railal?ility were sone of • 
the dlf fibu.lt ids .en!countered . As the problen^sVwere, 
overcome, thresholds were', observed in the wfly the SysTem was 
used* and oerceived. 

. AHJ iise tended 'fall into two discrete kinds, use as 
» an automatic typewriter ' and , with the more advanced users, 
use for on-line comijosi tlonV With use on a' re«?ular Basis, 
the skills were acauired that rendered the Systism^ 
" transoaren t" , so that the v ind ividual was:>^ no longer 
'concerned with System doeration • This tended ta free him 
for spontaneous, creative work while the rules of opersit^n 
.and syntax r^mainecl subliminal in , much the same way. as W^ith 
the uS|F? of lanRuapie in conversation, \ 

Observations of the ooDulatiop subsequent ta train^nn; 
notlri three areas of effect, (1) on the ind ividual , (2) on 
ftrouDs fnd team's,- and (3) on the oKj^an iza t ion . 

Hyoothesized effects were not entirely realized;- 
however, thev may be with add itlonal time and System 
develooment. At present there are chancres that point toward 
that realisation. Individuals experienced an unprecedented;^ 
flexibility and involvement with textual information throueih 
powerf.ul features suah as the lin'k addres.s, 
vi^wsoecif icat ion System, and information structure. 

' This power facilitates the construction of( an 
inforniation soace which may be easily ' and rapidly ^ 
communicated and shared with other AKWs^ to promote dialo^^tie 
. amonf^ task teams. The communication facilities. Send 
Message, Linkincr, .and the Journal System, 'were emaloyed to 
create new patterns of communication that would not have 
heen attained throufyh alternate m'eans.. The resultant 
oooumented team collaboration extended to the or<?an izat ion . 

Vertical communication im^roved , as ^new channel's were 
opened and formal channels were modified ' from the 
tr=»dit ional nattierns . The. System canabilities became a new 
manaprement tool which, increa^d openness without a loss of ^ 
efficiency* A number^ of examples of this were discussed, 
incl udlnfy ^collaboration, with' rreoe;raDically distributed 
• prroups arid the J=?har5.no: of soecial dialooiue file's. 

, ^ ' Display' terminals were availahl-e to a few of the 

ooDulation'Dro^otin<f a fuller real izatiori of the impact of 
AHI aided by human ens:ineered interface devices. A dynamic 

^ :i.nformation visibility was achieved, by utilizincr "windows*' 
into the information soace. The result was like traveling 
throuf^h the dynamically structured .in Cea?mat ion space ,of a 
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oom.munitv^ of knowled«?e workers«with such raoidity and ease 
that it was almost addictive* to the user. 

The effect of the sl^f^riif ican t chan<s;es in the work 
-me-thods and communication behaviors t^t were observed on 
fl:eneral attitude are reported in the next section. 

-(Note:! THi9 author's oufeclicaUion , ^' Exoerienaes with an 
Aus^mented hVt^ tnteUectS^^em : Computer Mediated 
Comnunication ,"\ Proceedings of the Society for Information 
.DisDlav, Second Quarter ,^1973 , is- bas&d on this section.) 



-is*:. 
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Section IV 
. ATT.ITUDE CHANGE. 

General . Attitude Toward the Technoloccv, 
the "T" Questionnaire 

The 30 item "T" Questionnaire wa's desij:rned to measure 
the population's altitude toward ttie general technoloprv 
represented by the AHI System. It .was administered to half 
of each of the user and nonuser s^roups as a pretest and to 
all of the DODulation durinq; the Dosttest (see the D^si^n 
Format in Section II). The Questions dealt with concepts 
that were lyiown to the Dooulation and that they could 
resDond to on the orete^t. The concept's (factors) that 
subjects were asked to* respond to are as follows. 

A. Automation in e:eneral ^ \ ^ 

B. ' The library u"s*e of comouters 

C. Comouters in- p;eneral ' 

D. Comouter dse to accomplish paoerwor^k 

E. Privacy of information stored in dc^Duters 

F. Typini? into the computeV 

0. ^ ' Computers as an . aid t^ thoufrht 

The ease of usinc* computers 

J. Comout^er as a device for^ interpersonal 
communication 

K. Use of com^uiers t*o assist in meetinc^s and ' 

conferences ) * ' ^ ■ 

The items were responded to on aLikert type scale that 
Included four Positions, stronc!:ly ac/re^ aerree, disa^tree,* 
strongly dlnafrree. The selection of^thre particular scale, 
was to force a choice betv/een positi^Sfi amd neccative 
responses. Thi^T'was based on^ the behaVior\l supposition 
that any latent, attitude that m^/rht^ riotN^e/ strong enoucrh to 
influence a selection other than neut ral^would be 
manifested if the subject were ^iven ntfih^utral alternative. 
This procedure did seem adenu^^te. . The t/otal score, 'rather 
than item scores, was of interest b?9sed on the assu^fript ion • 
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that the desicrn criterion of consistent questions had been 
met. A SDlit half rel iab il ity. test showed a hiJ^h 
reliability (0.7^) ^r.in^t the oretest. , ' '( 

Scoring was done by assij^ninf? a value of one to\1?he 
most Dositive response per item, stronqly agree, throun:h a 
value of four to the most negative value; stronii^ly disaccree. 
The totnl scores were then used for the statistical analysis 
which was done bv the Psycholoc^ical Research Center at • 
NSyracuse University using their library orograms. 

Attitude Shift Across Grouos 

The most |.m'Dortant results of irjterest Were any 
differences in fhean attitude scores due to System use, the 
independent variable- Differences in attitude amonff all 
ctrouoa were also measured • tq provide a control for spurious 
variables and * test .effects . Thus, a related t te^ was^ used 
betw^n the pretest ed experimental j?roup (errouP I)/and the 
Do^ttest experimental ccrouD that was pretested (II); and the 
piretested control grouo (IVT and the posttest control -^roun 
that was pretested (V), An unrelated txtest waffvused 
between the pretested experimental and the^..m:^i-jr)Btest 
experimental c^rouo (III); and the pretested conT^^ groun 
(IV) and the post test control ^roup with<iut theVpretest 
(VI)/' ^ ^ 

The results are shown in Table 1. There were no 
significant chansies in the mean scores among any of the 
orpoups except the pretest control group and the 
non-oretested control c:rouo which showed a mor^ negative 
attitude in ^the^ oosttest control siroup. Paht of the ^lack of 
si^tnif icance is due to the small N, which allowed^ few 
defrrees of freedom. * 



^ ■ 
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TaWe 1. 

" T" Questionnaire Statistical t Tests Between Groups' 



GrouDs II III V • VI 

Dost exp 1 Dost exD 2 Dost con 1 post- con 2 



ore exp 1 



\ 



-0.987 
N = 9 



1.569 
N = 18 



IV 

ore con 1 



-1 .560 
N = 6 



3.490* 
N = 17 



. II, III, 
V, VI 



F = 2^.491, analysis of variarice' 
across four ^rouos 



Further exariination of the results shown in Table 2 
confirm the t test. The standard deviations &re similar in 
all .the ctrouDsi at-Aeast enough so thatvt-he m,eads 'are 
roun:hly conoarabler^ It is dmrnediateiv obvious/that there is 
little difference between p:roups I.gqd II due to the 
independent variable. ^ There- is a sl-ifij^it^^^f erence between ^ 
these c^rouDS and the third us^r or" exd^rimental errpuD, III. 
Any difference that aoaroagJ^s a standard deviation a^onc; 
the ?rouDS , aDoroximately five raw score units,, is worth 
notin<^. The nore positive score in the post us^r c;roup, 
III, does ^^poroach this level. The fSct that it is "lore , 
l5ositive is encoura^ine; for two reasons, first, u^e of the 
System did not result in a /rK)re negative »score. Second, the 
nore necratjLve score, for the pretested users on the posttest 
can be- assoc iated wit'h test effect's. 
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Table 2. 

Questionnaire Means and S.D. for All GrouDs 







Ouesn 


\ 




1 OC I 




Groups 








I 


Factor 


1 Dev Factor 


2 Con 




X 






D. 


X 


S.D. X 


S.D. 


T Dm V 1 

i fre A 1 


73. 


99 


7 










II Post X 1 


75. 


77 


/6. 


37 








III Post X 1 


69. 


1 1 


7. 


60 


f * 






)IV Pre c 1 


63. 


2M 


5. 


73 








V Post C 1 


67. 


85 


6. 


62 








VI Post C 2 


75. 


33 


7. 


HH 








Additional - 


65. 


33 


n. 


6H 








II III V VI ■ 


72. 


26 


'8. 


00 


1^3.86 


12.69 82.26 


10. 34 



X = Experimental 



C = Control 



Test effects mav ^Iso be assoc ia t'ed wi th the ' differ ence ' 
between > the pretested control RrouDS^, IV and V. The 
cl^ifference is more than four and could be associated with 
maturation as well. The statistically sicrnificant 
difference t:)etween the pretested control ^rouo and, the 
Dosttest only control group, may be attributable to sourious 
factors (e.c;. oersonality differences). Whjat it does 
indicate / however , is th^t attitude tended^ to become 'more 
nectat^ive' due to maturation . The c^roup VI" score is very 
Similar to that of the pretested users groups, I and II.'- It 
is sicrnif iJcantly more negative ^than the postte-st only user ^ 
group, ^ II/, showing that a more nositive attitude may be 
eifhib.lted toward technology by a group using the System,"" 
than b.y a like ^yrpup without^ exposure to the System. .<^he ' 
"add itiongil" g,roup, composed of individuals who became users 
later in the, ex^oer xmental Period^, corroborate the more 
positive ^cores for users.. 

The pa»ttern of results ascertainable from table 2 shows 
a sli^?ht nef^ative shi ft \r\ scores from the pretest^ to the 
posttest in both the experimental and control groups", which- 
oro&ably is associated with test effects. The p-osttest only 
^roims (III and VI) showed that users were explicitly more 
favorable in. attitude toward Jthe technology than a like 
cont(rol erouo. ."^^ 

More individual subject scores sbt^ft^ed negatively from 
pretest to the posttest thus corrobora^incr the 
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differences dateoted by the exa^iinat it)n of ^mean e^pouD scores 
(see Aopendix J; note that a, ne.etative z score is positive 
.relative to the mean for that " ecroup- due to the scaling 
^odinf?: orocedure used). 

) 



Correlation with the Orscan iza t ional Climate Index 



The b^r Dose . o 
detect relations 
working environnent- a 
technolpcrv and the Sys 
this waV-^u;conpl ished by 
the scores <\f subjects or> 




in this inve,siJ^^t ion was to 
en the attitude toward the 

nd the, attitude toward the 
'particular . Statistically, 
orm in«? a correlSCioh between 
e two^third 6rder factors of the 
OCI and ^the A)osttest T .Quest ionnaire .(c^rouos II, rH,V,' VI). 
Tabl^ 3 sho^s the results. ^ 



'.^ •""N 

• ; Tkble 3' ^ -^^.^ ^ . > . ^ 

C^rrela^tion Between "f^' Quest iorina ire 'and ©CI 

"T" Quest ^ OCI - 
Post test ^ - - 

_Fac 1 ".-C^veloprnerri"' ' " "Fac 2' '"Cantrol" 
\ ' R ' . si^' R sle: ^ 

(Groups: . > - . 

II III > -0.662 ,001 .5357 .00^* 

V VI) ' ' . ^ , ■ ^ 

,?3 Ss were tested on both the £)CI and "T" Questionnaire 



The OCI factors. were ;( 1 ) develooment, and (2) control. 
Briefly, develoomenT^r<feT)resents a third order factor* 
oomorisincr those items that indiJfcate a positive att^itude 
toward the subject -"as a worker and his workins; environ-^en t , 
A hiPrh score would sho^ that an ^atrnosohere existed where the 
subject feels he- can develop, and is not unreasonably 
restrioted. Control reoresents the opposite, where 
unrealistic , unfavorable restrictions exist on the 
jjidjU^idual ' s develooment and profrress . 



■ The second order factors that coTiprise the third order 
factor for developm^ent' are:- -intellectual climate, 
orf^anizational effectiveness^, personal dienitv, and 
o>"derl iness , The control 'factor is cQmprised of work and. 
imoulse control. The work factor represents an excessive 
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work orientation and is not ?issociated with individual or 
•orpcanizational effectiveness (Richrffan and Stern, 196.9, 35). 
The 30. first order factors provide further clarification of 
the' third order factoRS \vhich are used here to, establish 
sub.iect scores (Richnan and. Stern, 1969, 65). 



The results were as anticipated, the^soores on the OCI 
fact*6rs siQ:nif i^antly correlated with T Questionnaire 

negative correlation coefficient is due to 
low scbre is posit ive on the^ T Questionnaire 



attitude. (The 
the fact that a 



whereas a hic^h sicqre is positive on the OCI F:actocs. Thus, 



tKe ^i'^jniflcant 
the/ attitude is 




positively, and 
their job, tend 



correlation between the control factor and 
in the exacted direction. \ 



The moderate but substantial re*lat ionsbio showrf 
indicates that individuals. who perceive the job environmeht X 

in general have 4( healthy perspej^tive toward^ 
to perceive the <^*eneral technolosty in 3 



similarly oositlve li^ht. ^ 

' The OCI al/so* provided 'a chex^k for sis^nific^nt 
differences in /individual att it ud inai structures across any 
of J: he R:rouDs oart-icularly the con troi versus the 
exoer iment-al ^rouos, that, miftht color -their oerceotion of 
any job related behaviors. ,The results indicate that there 
were no sicrn if^ican t d if iferences across grouos in perceptian 
of the ore:ani^^a tional climate.. (Note: These statistics are 
not* included /in this reoort due to the private nature of the 
scores which/mav reflect UDon individual subjects.) 




Correlation of "T" Attitude* and Intensity of Use 

The 0 Questionnaire (sed Section V) included a auest:^ion 
desicrned to oatee:orize the subject's estimate of the 
intensitv of System ^u^ac^e. on a daily basis. The categories 
wer^e (1) less than an hour per day, (2) between 1 - 2 hrs. 
oerday, (3) 2 - 3 -hrs. " oer day, (4) 3 - ^ hrs . per day-, 
and (5) more than 5 hrs oer day. The Q Questionnaire -was 
q:iven only to. System , users as a oosttest (see Section V). 
It was expected that there would he a relationship between 
the amount g person used the System and his attitude toward 
it. One „can only speculate about. which ^ni/^ht cause the 
qther -- "did System use affect attitude or' was System use a 
f unct ion o f a.t t itude . * \ . 

The N of is less than or ig.inally planned . this is 
due to attrition and the fact' that, this test was given to 
persons who had used the System on some -regular basis, at 
least once a week. It was^felt that this level of usa^e was 
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necessary for a subject to .be clg^ssif ied as a user for the 
nui^poses of the Q Questionnaire. (The negative correlation 
coefficient As due to inverse scaling on the two items; 
attitude was\jnore positive with a lower score and intensity 
was IjBSs with a lower scone.) 

It was cl.ear that there was a moderate correlation* 
indicatine: a substantial relationshio between intensitv of 
System use and attitu^le toward the e;eneral technology after 
use ( see table 4 ) . 



Table 4 > - - . 
Correlat ion^^^ "T" . Questionnaire and Intensitv 

"T" Quest .Ouestion # 23 "Intensity" 'N 
Post Exo J.-, • — 

R sj.^ \ . 

.« : . : ^« • ; 

Gpouos I and. II -0.564 ' .018 

„1V-^- --„----^-.. 

Ss had an adequate use level 



The results of the "T"' Questionnaire , althouRh^ showincr 
no sitrn if roan t d if ference ^due to the indeoend^ent variable, 
do provide insiQ:.ht into trie relationships between'^ind ividual 
attitude and the' disposition to use effectively a* technolocry 
such as the AHI Svstem. These ^relationships are elucidated 
by the data obtained .via the additional instruments, the 0 



Questionnaire and 
the nex t ' sec tion . 



Proficiency Test, which are discussed in 
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.' . , SECTION V ' , . 

STRUCTURED OBSER.VATlONS AND COMMUNICATION ANALYSIS 

. . ' ' \ 

•■ . Consent/ Oue^tiotinaire ("0") 

. This auestionnaire was- desi^ned^^tp obtain reactioA3 to 
SDiecifXo statements and answers to spec if lo ^ questions ab.out 
the AHI^vstem ati.d the subjec t '-s -e^peri^enqes with it. The ' 
Questions were dire'cted at_a number of areas includih:c!: 
effectiveness', in terms of a'ccomDlishine; paperwork 
activities / effectiveness of communication tools., 
^ttrac tiveaess as'an, alternative to •handwnltine: 
documentation dra ft#s , <fene^al feelinj;s about the' System , use 
intensity , term in al use , ;^-qual ity implic ati|ns for tho^ught 
and written d^ocumentat ion , System resource lavaiiability , and 
predictions about fyture- a-tt'itudes and .experiences. This 
instrument was a- direct nethdd of obtaininsl subjective - : 
resDonste's about the System's effect. It walls administered to 
the: user J3:roup only at the end o f. ,t]ie experajrien tal period. 



Item" Discussion , * 

There Here a total of 2\ Questions , 19 of which used a 
Like^rt type scale (see Appendix G). An analiysi^ was, done 
usine coi^.relations between similar Questions, Questions 
which could indicate^ causal relati-onshzDs , and major 
variables -^'three of which were measured by this 
ouestloniial^re : » System availablity, inten-sity of use, 'and? 
terTninal type. \ . • 

Question one was designed to compar^e actual user 
experiences with their expectations before th^y were .in 
contact with the System. The System was introducerfr,- 
primarily as ^n aid to paperwork oroce'ssin^ and^. the . 
concomitant functions that are accomplished in, ^he d&4.1y 
work routine. This included tj^xt ed il^ins and the 
preparatio'n of longer documentation such as reports, etc. 
The 'empfias is on common icatiph via the System was not 
deyeloned at* the bec^innin^ of implementation ; thus, this 
question would tend not to detect expe'c tations ^about' 
communication u^pae;^. The majority of 'responses were 
neutral ^ while the remainder/ with one exceotion, were 
mildly in aG:reement. The lar^e neutral response was 
orobably due to an embVyonic^ concept of the^ System desi^^jn - 
s;oals and punpose. * Therve may be a strong relationship 
between this response and^ the usage experiences 'mentioned 
earlier, which show a marked threshold during the evolution 
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in .usa<re fvorr ah automatic tyoewriter to oh-line 
composition. That threshold may be a function of* 
. understanding th?it the System is capable of more advanced .* 
^'3bplications than the te^t ed iiing assdaia'trg^*"^^^ an . 
automatic typewriter. . ^ , * . * V 

The*" chane^e' of attitude resultant from use ttia]^ was 
^ detected by Question two, is one of the' mo3t' sieinif icant 
findings. This rasoonse indicated that the. System was 
positively reinforclrie; « for about, 775 of the users, with 
almost a Quarter stronoily aoireeins;. This 'misiht have been 
largely due Ito nes^ative expectations initial-l.y, resultincc in 
a positive 3hift after a more positiVe experience. However^ 
the "^T"^ Questionnaire pretest shQwed that at least 'the 
attitude towar^d the pceneral concept of the. tectinology was 
not neo;ative a priori. /The G^eneral expectation wa*s neutral, 
■ thus negative e,xpec tations dc5 not appear to be the/c;aUsal 
factor. Number eipcht" corroborates this, by ^howine; that the 
subjects anticipate (over 3/^ of the subjects ) that their 
•opinion will becot^e mor^e^^posit ive^ with add it ional use . - This 
,ant ic ipation was stroh^^^r for thi5^e with limited experience. 
ApiDarently, a majority ffeel .-^hey have limited experience as 
indicated bv their posit ive response to O'Umber eieiht. A 
five by five contino:ency table (see Appendix F) shdws that 
■'all subjects answered these questions within .one^n terval', 
,witW the larre-st o;roup answering?:' ^'agree" for bothj 

• - ■ *■ • .■ ■ , ■ « > 

The posit ive correlation between number seven, where' 
H7% indicated that thejr W^ere more efficient, and num^ber „ 
eio-ht, where the' majority expected that mor.e use wd\uld. 
. increase their opinion ind icates th'at'^the subjects are ^ 
experiencing? reinforcement (see Appendix F) . Number^ .three 
detected one of the sounces of reinforcement, a reduction in\" 
throue^hput time j al thoucrh it was- not sensitive to an' ;^ 
increase in throuc^hput time if there was^one. -It is' 
3ii?nif icantnthat more than half the subjects found, that ' ^ .\ t 
. throupchp^t time decreases when usink the System to. prepare* j 
paperwot^k. ' A continf3;ency table shows a st ronct co-rrelation , 
t)etween number three . an^d number seven , which corroDorated 
t>mt they were niore efficient (see Appendix F). These • * 
r^Wc^ses stress th-e ed i tinc^. capab il it Les of the System , /not 
;the communication uses. ' • 

^ \,. > The Reasons for ..this increase in ^e^f io^iency. ca^n ortly be 
interaolated^from the other resppnsres. Number ^leve.nf^. . 
iq^dxcate? that it is^^not due to les^s -need to vrlte Ipn^^hsind 
drafts. However, number fifteen^ whVch showed that a . 
' njajoritv felt that tlpedr thinkino; about written ' woi^k done on 
- the System was improved, offers some expl'&i'hkt ion .. Oniy 18% 
disaccreed with , the statement- that t-heiV -thoucchti was 
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enhanced ; Number fount j9j©»n indicates that, a ^majority d(\^ not 
perceive the System as beinc^ effective for gll job ta3ks, ' ' 
thus -suDportine: the conclusion that the noted increases^ifi 
effective'nes are spec if ical'Jf^ /for the production of / 
tvoewritten material. • Number/ twelve again discriminates ^ ' 
between o||^r,alI effectiveness and paperw^ork actlv.ities a 
majority exoected that paperwork c,ould .be accomplished more 
effectively by ahvone who used AHI* - ^^'^ . ' 

V' - ' v • . . ■ • • ^ . ^' ■ - ' ■ 

The quest ipns about System use as a communication tool, 

numbers 17*and 18, show that a majority*do not Tix\4 thi^ has. 
been an,imDortant feature. Observations indicate thgt- the - 
communication features In i3;<°neral were not used e^c tensivfel y , 
.thus establ'tsh tnR t^^ cause' for a m^ajority response of 
neutral.. The proficiency exercise showed that a si.c;nif ican t 
number of subject^s d,id not know how to use the communM.cat ion 
faclMties .(see below).' - o . • , v . 

'N-umber five aoDQare'd in retrospect to be a* confusing v 
question, but it did indicate that the' major ity found 
reasons other than a lack of written material for not usin-g 
the. AHI System . ^ _ . ' """"^'^'"■'--S. 

Although' there ^^as considerable support for an. increase 
in efficiency, number six clearly- showed that the 'large" 
m^>jority sawr-^ quality implications €or AHI, even thbugh 
they saw an enhanced thinking- ability (number 15-). 
Gb.servatXon su«Tgests that" causal fadtors might^ be l^imited 
experience with the System, the inaiDility to \xse the display 
veV'sion of AHI (less than half of the subjects), and the 
difficulty of judGcin^ aualitv. In spite of these factors,- 
th¥ response hag signl'ficant implications for individual 
'^.ffects of AHT: after an average o if six months of use, with 
?5 ma.iority using thQ System more than one h^r a day at the 
six mpnths- Doint, three quarftgrs /of . the .s^jects were 
neutral. about an increase in the quality of work . \ ' 

accomplish^Qd on AHI. / * . 

Number nine shaws tha^ more than of the users see 

AHI as an a^^vaace in" the^ st^ t^of^-the-art , which is .both- 
remarkable -knd sie^nificant in light of the fact that most 
subjects are in ^the business of ad<«^^an^ing the . 
state-of-the-art- through R^a^aj;igh and Development :in 
information science." Th is *al so illustrates a dispa^ty 
between off-the-cuff, commeots, many^'bf which tended. Trol>e. 
derrogatorv, and questionnaire responses, olt cannct J^e \ 
determined wh'at< rqle the lack o'f anonymity had on th.is 
nositiye response or any o|,her pn this quest if)nnaire The 
."back pattinff" phenomenon may be a factor. tt is ^ 
conceiv.abl e , althoupch no t' probable , that the population 
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reno^ni^fid the Svsten as an*, effort on? tlie oart^ of ccillean:ues( ' 
and as a source of funds for the or^an tza t l^o^ / ^hus " ' . 
indirectly suonort In?: ' them . ' ^ ^ , - - / 

Prc^jbabl V ^he most difficult statenent' to .respond tg-^^ * 
Dositivelv was .nunber 'ten\' whio^h- tasked sut.iects to .relate to \- 
the overall qo^ls and theoretical foundation/ justification . \ * ^ 
"for AHI as a unlnue system: -that it will positively imo^t ^ " 
effectiveness in al T -aspec ts ofUnowledqie work. ' - • ' V| 

SurorisinfTly , H7% atrr^ecj ^wh i le ortiy disagreed. The *;v " 

neutral responses may be from thosre who^ are w'a ^^ inrr for ^ 
add it ional experience . Cues tion, numb'er' one seem'is to be " _ 

related to ten in that tbe-^exneotations of what the Svstem_x . 
will b.e (."imorove e f fee t Iven'ess in almost evef^vthinR that i3 ^ ^ 

iob related") 'are slightly Rreate> than what it appears to 
be now. The ^a.iority of the subjects anticloate that the 
System will imorgve effectiveness in crenerBl even* 'thQucrh' it * 
has not vet fulfilled exoec ta t ions . 

' Questions number I2;and nu'nber 13 clearly .show tha't the- 
lare:^ majority of fjsers feel that the Svslem has .general V 
learnability and is not limited t& so^e select errouo with 
special a'DtiJtude or skills. This- was of Q:reat concern^' 
initially ;1ue to the exien^s^tve' 'c^nolex ity ' or t^e command ' 
structure and syntax. .How^ever, the r^soo-nf^e does* no t(/^^y 
anythinq; about the level of use tha t . is > aocomolished wlt>\ 
"relative , ease" . The nro f ic iency .exe'rc ise and ■ ob servat,ions . .i'>-^ 
arrain* indicate tha t\ the^ v iewnb int of the subjects is from a ' * / 
\^'imited level of expertise' ^-' a nToder4.te^' or half-wa^^ ' , ' 

sboh^stioa t ion of use relative' to the "moVt adeot user in the. 
Donulation Nevertheless it is* imoor'tan t that this level 
or use, Drimarily -as a t,ext ed itor , as perceived as 
attainable byl^iyone. / \ ^ * • " ' 

The. fo.ref^o-inp; discussion about lower- than -ex oec ted use 
as a oon^un icat ion tool did no t deal with* nu^nber 16. Jt was 
almost" unanimous that . file sharine^'is an e ff ec t ive tooi^ for 
keenin<^ irifor^Pd. This results from' manaprement usacje and 
oolicr. for the or^ranizational un i,t , which is a function of, * 
one person. The first 1 i.ne mana^-^er regies very heavily on * . 
one open, file to record directives^ riue dates, meetings, and ^ 
^ost other supervisory matters of a^ ff;eneral 'na ture . - Thi?; - / 
Tile is' used by subordinates fop^ert»inen t responses and to . 
k^eo abreast of what is hanoenincr to their colleagties'. It 
is difficult to predict from ^ this ^.cas^e, which, appears to *be 
very m^unjn" a . fun- t'ion of individual stvle, ex^pept tq^ say th.at • ' ' ' \ 
it is a 'communi.catlve technique tfhat.does work' (Sjse Section . 
III., '"'Use ' o fCommundcati.on^ Tool s'* ) . ' ■ . - ^ \ ' ^ 

Questions 20 throucrh 2 3 ,w^re important, to dete>cfe . / ^ 

• ' s * - ' ; ' ^ 
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iTiproved 'at t i^\^e^ wJJLii^us.^^ 
rhole there was no correlation 



X negative influ^ces on attitude. Svsten unavailabilil tv 
"(numbers 21 and\22) would be a negative' oausal fadtor^; 
however, a majoritv of the subjeatsSr found^t available most 
Qf the'atne. J^Number 22 did not si<^ni f Ic^ntlv correlate With 

tWOj^..^^ich de tec ted 
Anonp: the oonulation as a whole 

between reactions to the Svstem and availability. However, 
In* certain ind ivid ual cases it was found that those who had. 
a* terninal available less than UOjl 'of the time s<!ored below 
avera<^^* This is moVe^ .importan t when it is noted that'^the • 
same subjects re^Soonded with low s.otires^'on most Questions. - 

' ' 1 " • - 

A majority found* the Imlgo CW f\ore effective to use 
(n-umber 20) ,but tkxis is more an indicator, of those who could 
use 1:.he CRT rat'her tl^an an assessm^int by everyone it was 
not , available to ^more tha^ kO% of th^ u§ers. It -cart 
Dr^eflictied from observations th^t l^"ad everyone' used the CRT, 
they would have preferred it unanimously. . 




The total scQre* oojbhe Mkert scaled question^?, one - 
19 (-yal^ues stronctly ^i^ree ^ 5u strongly disagree = 1), -did 
not" correlate with either^ 21 o*r 22..*' This method of scoring 
was nojr^ st^^t iftically sound (the items werif not desit^ned to 
neaStrfe the same thin'^) and was on^y don^ to see if any ^ 
add itional battern' could be detected. The Z' score of the 
summated scale* Quest ions dtd; hotvrever, provide a check on 
'^the interrelat iopshios between 'attitude and perceived ' 
' e^ fecrtivenei^s . Those who., did not perceive an increase in 
effectiverpss had nectative Z scores, and the two *cases where 
the Z score was below^ -1 also had the lowest scores *on 
ef f-^^ct ^veness . The relat ionnhlo was the. same for the hicli 
scorves; ^ An "eyeball^ of the tabular data .(AoDendix- J) , 
Ijldi^'ated that the, /our^ffectiVeness questions '^aried with 
tloe. total score; - ^ ^ . . 

There were twoclusters of items 
in the data , ^'projected attitude^' and 
-attitude auestions (numbers ,twj 
within the two- item^, with aV 

Table 5.), but-*were not c'onsijfDerti>- with the total scqre or 
.the effectiveness que^st ions/ Tfta t is, a hisch comlj^^fed 
answer score coul^ ■no.t,be used* to •oredict hin^ sc^es 
elsewhere. The most\li'kel y conclusion from this 'rtay be that 
th^a tt.itudes represented a Predictive frame"' of reference, 
vthereas the effectiveness and* o,Y*ef*all scaled- questions were 
retrosnec tive . This is ccfnaistent with the content 'of the 
questions ' * 



that ^er'e noticeable' 
. VeTJec tiv^eness"^ ^ The 
and elatht^ were, consistent 
'dcrh intercorrel?ition .fsee 



"The ef fectiveness^cluster dnu^nbers three, seven,' 
twelve^, and -fifteen) also wa? based/on a his^h correlation 
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anonp^* the, co-^stituent Questions (see Table. 5). Thus, 
subjects who acorecl highly on this factor were indicating a 
stronir response ^bout the Svsten's e/ f ec t iveness". - The 
scores on this factor varied in much the sane manner as d'i^^ 
the overall score on the 0* Quest ionnaire , as indicated by an 
eveball of the data (Apoend.ix J). More impartantly, there 
was a correspcfnc^ence betweenf the loW scores 'on the attitnade 
faotar and the attitude from. the T Questionnaire. . In fact-, 
if a subject was at e'ither extreme, all the scores tended to 
he at the sane, extreme. Thus, we can see sqme consistency 
between general attitude, opto iec ted attitude, ef f ec tiveness , 
and the toffSl ey^^luation of the' svste'*^, although nqthinf^ 
approx i;nat InR statistical sifrnificance. 




. Table 5. ' 
0 Quest idnnaire Item-with-factor Correlation 



Items Factors 

' 0 

' J 

Attitude Effectiveness 



? ^ .7^9 

\ .8 .838 

• 3 

7 ^ 
V2 

'15 . ' 



Factor rnean 3-92 ^.93 

Factor S. D. 1 . 10 2, 7^ 



.7^*5 

^825 
.8i*0. 
. 8^Q 



Sum'iiarv of Questionnaire Flndin-c?s 

The ouest i(/nna ire. resul t s were c^^nerally consisten t^ 
with the Drediotions of* system effectiveness for individual 
use- The si'^plfioant except ion was ir) terms of quality, 
which was Tound not- to be enhanced. X^.us , effectiveness- 
"cannot he .defined as hi^rhe^ oual ity out out m less* time, .but 
simply increased output (or throu^^hbut) with less effort ^ 
Attitude and oerceiyed' system ef fee tivenes .were ' found to be 
consistent, which was a major nethodolprrical hypothesis, ^ 
Farther extrapolation from the r^esponses about oresent 

ff.ec tiveness and predicted effectiveness indicated that 
svstem nse'*is rev/ardinpc. Experiences were oerceived* as 7 
imited, but thev must have been reinforcing?: in order for'^ — 
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the ^m.^Jority of the resoondents to an tic ipate'an improved 
attitude. / 

.The Questionnaire in c^eneral ,^and %he questions 
concerninj? inten.sity of use, were cort^istent witJr\ " ^ \ 

measurements of profioiency. This provided . strong evidence 
to suoport the conclusion that subjective responses are. a 
valid. neans of ascerta in inr^ the utility of the System. 

TNLS Proficiencv Exercise 

ft The orofinienov ex^u^cise or "test" was desit^ned to 

measure the ability of a user to edit a oapac^raph of text, 
to link to another user, send a messat^e and tfansmit the 
corrected text throu^rh the Journal CSee Appendix E). The 
exercise was presented to ?ach u^er on hardcopy, with- the 
unedited and a corrected version of the text. The errors 
were marked on the unedited text proo f read inr^ time was ^ 
not of interest . , ' i ' 

The results of the exercise were .tabulat^-d by countint^ 
the editinc^ commandos that were used by each subject, notin^^ 
the^ time reouired . to comol ete the editinit, and the num.ber of 
erYofs in the -edited text. Subjects were asked to record- 
ttie time bv exeoutint^ a snec ial* control^ character which 
^prlnted the total connect time to_ that point. (At the time 
of these' tests, the. Svstem did not provide ap automatic . 
record »orr the time or the editinct commands used.) 
Interruptions were noted in tfle same manner. Errors in the 
edited ^copy were .campensated: for by -ad^Jinrr one minute and - 
two commands for each error to thevtotal number of commands 
used. This was based orf .the averac^e time and number of 
comnr^nds necessarv to execute the correction had it been 
done bv the sub iect initiallv^ ^ 

A rank order qorrelation was performed between the 
editincT time and the number of com'^ands; editinc^ time and 
the number o-f months of system usaqe ( loncrevity ) ; and The 
editintr time and the intensity of usa^e. frcSm the "0" 
nue^tionnaire (see A^oendix J). 

Pesul ts . . - • 

Lon^evitv did not ^lp:nif ican tly' cqrrelate (at the .05 
level) with anv other -variable . ' This verifies ig tuition — 
"oncrevitv alone is pot sufficient to acf^as a causai ' 
v^iable. For example', a skilled user may continue to. use a 
lartc:e 'number of commands, but execute them more rapidly with 

J * • * 
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fewer orrorr>;.> or the style of erlitincr teohnioue nay cause 
more con'^an^ds to be uaed desDi.te crreater lonf^evity. Rather^ 
the effect of lortsievity is a function of tKe intensity of 
use, e.t?-., certain subiects crained ^lore skill In a /shorter 
overall lens:th of ti^ie^due to more intense use. This 
initial anqly^^is doen npt eliminate loncrevity as a causal . 
variable but onlv nermits t/he followinfr conclusions. 



(a) Greater loricrevity did 'no-t result in the use of 
fewer edit inn;, co^man^s. • : 

) Loncrevity did not si<7pificantlV correlate with 
edittn^^ time, -althouf^h there was a definite tendency for 
those with' prreater lonctevitv to have lower editinf?; ,ti<nes. 



(o) An alternative editinr techgpLaue resulted in larsje 
differences for those subiects that used it confoundin<t the 
results. • • ;,-»<*^ 

The use of an editinp* methoit called "execute edit," as 
ooDosed to the ur>e of indivi?)ual commands for each editin^^ 
ch^^'nee, resulted in a sif^nifioaht reduction- in ^both the ^ 
nkinber of commands and time, indeoendent of the other 
variables. / . ' - « ^" ' ' v 

Ex'^^cute edit pennits a u^er to edit a sta temen t * v/h ile 
that statement is bein? orinted by deierminlnp' the ^ . * 
annrox i'«^nte lo'c^tion of the error, and printirle; tq ' thaL 
nolnt. The'error is -typed over correctly, and orin^nir' , 
vrncef^ds until the next error is about to be printed. The 
nrocedure is n-eDe||pt.<5d until the statement isi^onplete . In 
tabulatine: the number of com'^arid s used , e^ch correctio\ was. 
oounteH as a comnand in order tn ano^oximate t-he counting-.:* 
use^ for the usual nrocedure. Execute edit was conclude^d to 
he more erficient orimarily because add ress in^^. the point of 
text wh^re there is an error does not have to'^'be dotne within 
the statement (execute edit onlv works wit+iin siratTe^ften tqT. 
When individual editinp" commands^re *used each' textiial error 
must be addressed beff^re the correction Qan be*made. Only 
three user's emr?loveH execute edit., and all three vrere amonpt 
the best times and used ^the fe^wesV Inst ru'(?'tlons . 

However, wh^n nJbhe^^ti^ree .jsub jec ts who used this ' > 'm 

alternative x^^e d ronned ' f ro^ ^he d ist.ribufeion^'there was 

still no si^nifiCRHt cor^t^elation between .oerformanjije aqd^ ^ 
lonpcevitv. ^ 
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Proficiency as a Function of Intensity of Use 

Lon^evitv bv itself was not found to correlate wi'th 
skill, indicating that intensity of use. was a more important 
factor than anticipated. The intensity, or decree of usa<;^e 
durinf? the pertod of longevity; was measured throuc;h a 
direct question on the "0" tiuest ionnaire . 

'The multiDle choice ouest ion asked a user which of four 
catec^ories were appropriate to his experience: (1) less 
than 1 hr., (2) less than 2 hrs., (3) 2-3 hrs . , (4) 3-^ 
hrs., and (5) "^ore than 4 hrs. ner dav. 

The tabulation of data shoWe^-^hat the c;reater the 
iqtensitv of* use, the better the "Der^foVmance , particularly 
with resoect to edition? time. Statistically, .a siccnificant 
rank order correlation (at the the .01 level) was found 
betwee*n editing time and intensity ( + .7^). 

Althnucrh there was no correlation between time and 
lon^^vity, it was concluded that lonp^evity must influence 
editing timfe, to^wit, intense- use over a longer period of 
time* would m^ake a user more oroficient than would the same 
iht,ensit,y over a shorter time period. In order to detect 
anv^relationship, intensity and longevity were treated 
toG^,ether.* The respective scores were multiplied to f^ive a 
coml>ined val^ue which was called " lon^.tensity" . A 
.sicrni/ican t correlation *(at the ,the .05 level) was found 
be^tween editing time and " long tensity" ( + .67). 

' " ■ 

Lonqitensitv represents the variable that most 
influences anv learn in^j^ituat ion — the combination of the 
l,en(y.th* and the numberyof Jtrials . However, there was no way' 
of accurately' record/ncr t*he time each subject was spending 
at^'the .terminal dur'fnpt this time period. Tlie Svstem did 
keen records of Svstem use time per directorv, which is 
defined bv the user's name, but different subjects other 
thvan^ the person it was oriccinally establisheri for used the ^ 
directorv. There was a shortaece of directories as welJL as a 
need ^to" have clerical hel'P'enter and edit some of the text 
for certain subjects thus adding their time to that of the. 
subject. The shortag:e of directories led to a sharinct amons; 
sub.iects who became users rel'ativelv late in System 
imole'^entat ion . 

Lonprtensitv represents the variable that most 
influences any learninpr situation — the combination of the 
lenccth and the number^ of tri^^ls. However, there was no way 
of accurately recording the time each subject was' spendinc; 
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at ^^e terrriiril durine this ti-nei -pe'-iod . The Svgtem <Jid 
keep n^Gords of System ush time per' d irec tor<,y » which is . 
defined \by the user's name, but different subjects other 
than the person it was originally established for used the 
directory. .There wa.-j a shortage of direcitories as well a 
need to have clerical help enter and edit some o,f the text 
for certain subjects thus adding their time to that «>f the 
subject. The shorta^re of directories led to a sharing amono; 
subjects who became users relatively late in System 
•implementation." ' * ■ ^ 



Although there yins 'no correlation belw'een- tim-e arjd 
lon(T.evitv, it, was concluded that lont^evity must influenQe 
editint? time, to wit, intense^-use over a longer period of 
time would make a user more nrofic'ient than would the same 
intensity over a shorter time oeriod. Irt order to' detect 
any relationshio, .,inte»asity and longevity were treated 
to<rether The' respective scores were multiplied to give a 
combined value which was- called "long tensity"'. A 
significant correlation (at the the .05 level) was found 
between editing- time and " longtensity" (+.67). 



Loncctensity re-presents the varia'ble that moat 



influences any -le'sming 3-ituation — the combination of the 
leniTth and the number of trials. However , ■there was no way 
of accurately recDrdlncT the- time each subject was spending 
,at the termin;jl during this time- oeriod . 'The System did 
keen records oC System use timf per directory, whi^h is 
defined by the user's name, but different suhjects other' . 
than the oerson it was originally establ ished' for us-ed the 
directory. The-re was a shortage of 'directories as well as a 
rj.eed to have clerical helo enter and edit scfme of'the-text ' 
for certain subjects thus adding their time to that of' the 
subject. _ The shortage of ^dirqctories led to a sharing SnOng 
sub-jects who became users relatively late in System 
imnlenientat ion . ■ ^ . 

Th^^ sharing of d irec torie's also complicated the use of 
the commun-ication facilities. VIn a minority of cases, it 
was not Dos^ible to send mes8.a?e-R or- Journal mail 'directly ' 
throu^Th the System because a dfrectorv is re'qui'red to 
receive them. Althoucrh there is an alternative means "pP 
defining oersons to the System (the "ident system-"-), that 
permits delivery of hardcooy through the "mails, Sn'd 'hot 
on-line, the time lag under -these circumstances is. one to 
two weel/;s. Essential ly the System does not -know -who' a user 
is except _throuf^h the directory under Which he ac ^om ol ish'es • 
the locTfTing procedure. , These problems justifv*the :use of a 
subject's estimate of his -intensity of Use and lonsev^ity. 
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The learn inp; ^Di<^ ture is further complicated by Xhe kind 
of ooerations performed difV'irtG: the- use period. Everr thouf^h 
there was -a hicjh cort^elation' between. ron«3^tensity and 'editing 
tiyne^ it is not clear that the mere Quanrtity of time will 
insure an increase in skill. Questions remain about the 
likelihpod that a nerson will attempt to increase his 
knowledP:e by tryinc? altgrn/?tive commands, reading; the 
documentation, askincr Questions , ^and ccenerally e-xercisinrj 
some creative curiosity. If he does not do these thinrcs, 
the va'st richness of the System may mever be tapped. 



It was concluded from observations that thUs kind of 
seVC-Jj^truo t ion is* a function of individual differences , 
deno^qifids on the individual to produce, and the availability 
of ^helD. When ^ subject became reasonably comfortable with 
a certain set oKcommarfds anH procedures, in (general, he wa3 
not too ^ ikelv to\ attempt to learn n^ew commands the 
m^om^n tu>n Dhenonenin . The oarticular "rut"^one found himself 
in resulted from Init ial ,tra in in«2; in most cases , and w^is 
foun'd to be inefficient for the broader spectrum of tasks 
found in nost-traininfi^ applications . 



Proficiency and Communication 

The most imoortant' ramification of Vc\^ momentum 
ntienomenon for this stucly was the lack of use of the 
oonrmunicat ion facilities, compounded /by the System 
limitation mentiqned abov^". Many -iSlJbjects attempted to sead 
communications through the System for the first time durino: 
this oro fic iency exercise . Thus, the exercise became more 
of a learning exDerlence than a testinc?; device for the use 
erf the communication toiSls. The one exception was the use 
of shared files, an important* resoonse tc the immediate 
supervisor, and also requiring a minimum of skill. The 
overall results showed that almost half of the subjects wer^ 



not familiar With the communication portion of the test 

* In terms of this study, this is a significant 
confoundinf^ variable. ConGlusl6ns .about AHI as/ a 
communication fnedium for facil ita'tln^ the dev^opment of 
n-rouDS, teaf^r>, and the ori?Taniza tion must be ^interpreted as 
reor^&sen t^^ t ive of the least amount of impact possible. It 
is extremel y orobable that there would have been more use 
and tli-erefore 'rreater impact had there been a ri<3;orous 
trainincT or testinct orofyram aimed at' e^urinp; a capability 
on' the part oC each subject to use all the tools for 
interaction. Rather than being ._a loss in terms of 'the 
^pjj^dy's value, this is a valuable insight: during the 
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inplementg t ir n of gn AKW, steps should be taken to insure 
that a basic rnasterv of all tools has occurred. 



The same is true for editing tools. Had everv subject 
been versed in all caoab il ities , he would have had the 
"execute edit" command available to him thus imorovinq his' 
editing performance withinvindividual statements 



The imnortan t fin diner 
use by a population "there w 
the communic^fcsLon features 
major power o.f t\e System, 
that this medium rs'^ot at 
an alternative to conventi 
telephone, face to face 
(see the Communication Tallv »^esults) 
editinpc capabil itie§.,,--^frhe commun icat ion 



that after several- months of 
not a basic familiarltv with 
f the System , which represent a 
This leads to the conclusion 
r^c tive enoufTh Co be selec ted as 
nal ways of comnunicat incr by 
tact, or written correspondence 
In contrast to the 
patterns are 



entrained more cte^ly in ps vcholoG:ical structures such as 
nersonalitv and social milieu. Intuitively it is obvious 
that callincr on the phone or walkin^^ down the hall and 
droppirt^^ in are quite easv when compared to lopr8:in<y o!^o a 
computer system and then'^ac tuat ins^ the precise, although not 
too complicated protocol. 

The scope of the on-lind^, community that an /ind ividual 
needs'to communicate with, is another important"^lN^c tor . In 
this case the immediate orc^an izatio'nal unit comprised the 
onlv portion of the on-line community that was orOLnterest 
to the subjects. Had a larc^er , number of communicants beeKi 
members of the on-line coTimunity, as was the cjj^se for a 
exceptions, then there would have been a great deal mor^e 
motivation to communicate via the Svstem. - Georrra Ahioally 
distributed communicants would have further increased the 
motivation. 

^ The exoentipns incl uded those AKWs who interacted 
extensively with the California ARC utilizing all the' 
featiares . A number of /other users external to the 
opnulation nrqvide a twofold exception; thev commun icated 





ex tensivel V 
only Svstem 

howevp-r\, was responsible for the developm 
as well V^^j^^ponsor in^T the entire AKW proje 
special mot ivation' for them to accomplish 
correspondence through AHI. 



ucth the sen'd 
ure they did 
ponsible for 



messacre feature *v;hich was the \ 
use . The particular office ; \ 




Network 
provided 



Earlier, t>re concent of a threshold in the transition, 
from use as- an arutomatic typewriter to full au^^men ta tion Vas 
introducevi. The Proficiency te^ provides the basis for the 
concept of a "communlca t ion thresho^ld , " a definite change in 



\ 
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the behavior ored ispost ions of a person that are necessary 
for the 'neaninirful use of the communication facilities, not 
only to initiate communications bu.t to receiye^Hhe|m as well 
The communication threshold nay be passed .throuVh'''^trainin«? 
and indoctrination leadin^^ to an in depth awareness of the 
facilities, thejir potential, function and usa<re. 

Conclusions About 'Proficiency 

Lonctevitv was not found to be a key factor affectin^r 
the subject's proficiency. / Intensity of usar^e played a more 
sie:nificant role in influencing the editing speed, which 
decreased gs the in tensity \bf usi increased anmong the 
subjects. The number of c o rtr»saJ2fej s did not associate with . 
either intensity, longevity, or editing time-. It was 
surorising that a more skilled user could accomplish the' 
editinPt task with a, similar number of commands , but in much 
less time than a unskilled subject. ' ^ 

The combined interpretation of intensity and longevity, 
"Ibntensity," did correlate with editing time, but it was 
not more significan't than "intensity alone.' Logical^v; 
however-^ it must be concluded that skill is a functiOfi of v 
the intensity'of use over time, and not intensity alone, as 
this samole sug<^ests.- We were not able to determine the- 
ooint at which skill levels off in a learning curve^ It was 
not Dossible to\establish learning curves because^^'Trf the 
reouirement for herio(^rls> testings, which this population was 
vnot willing to acce^ot. It is likely that lonctevitv olays an 
important roleOintially , \but after a tim^ oeriod such as in 
this study ( seven months )\ intensity becomes the more 
iTipcrrtant factor bv enabli\ng a user to retain his skill 
throuc^b ' practice , \ Thus we\can pred ic t ^that a certa in amount 
of oractice is necessary to, retain any 'kind o f"" competence , 

An alternative^ editing , technique , execute edit, was 
found to b^ suberior\for ed it ing^ within statements.. It 
would not hel D ;^however , when minor' editinn: was requir^ed 
within each of a ntfmber of statements.* 

Evidence was accumulated supporting the 
conceptualisation of another threshold (see Section III) to 
be Daa;sed while becoming? an AKW, the "communication 
threshold." A considerable amount of. momentum was found for 
continued use of the System as an editing device onlv, .It 
is not ^until a certain amount of traininec, indoctrination, 
exoerience and need have occurred that an individual . 
prop-resses to utilization of the communication -tot>ls in a 
meaninp:ful way, * 
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Cornniun ication Tallv 



It was Dointed out in the review^-iOf, Literature that 
Conrath's method of p.prnrnunfcation analysis witlnin .the 
ore-anizqt ion Was the the latest development of t.he most 
aporopriate technique for examinincc the effect of conputer 
systems on an orR:an ization . The technique' was 'applied to. • 
the exner imen tal and control erouoa for five d^ys at the end , 
of the experimental .period . At a meetinG;.of the entire 
population called at' ttie request* of -the Branch' 'mana(7ement , 
the Durpose and method were exolained by Dr% Conrath ^ 
followed by a question and an^jwer ,i§ession. '-Conrath was ' 
called in to assist in the mod if ica.t'ton and rest ructurin-^ of 
the tallv sheet and instructions, and to lend objectivity 
Jiid persuasion to the invest icrat ion . It was expected that 
tjne\ techn ique would be resisted and that every effort should' 
T)*e.made to encourasie reliable participation;- 



* The soecific ^oal was to measure the usa.e^e of the 
communication tools that the System offers anc\ compare them, 
with the conventional patterns and channels of. ^communication 
within the orfranization . The administration of , the 
technique to* both the control and experimental «?roups 
provided a camparison of two like ors*anizatior)al units, one 
with and one .without the System as a communication medium. 
The most important result was to be able to dodumeot tl^e 
specific communication feature beinci: utilized an'd to • 



establish what portion of 
behavior was throui^h AHI. 



the S's t©tal com/nunicat ive 



The results were reoorted by Conrath*' ( 1 973 ) Ih ^ 
special report. The data, consisting: of the tabulated . 
transactions fop each pair of* communicants were codeJj by ' 
mode and by nar tic ipan ts', and by the' relative ^os.ltion an^d 
location ►of each oarticioant in the orft.anizat ibn'.> ' Vgl ume 
communication wa^- 're.presejn^ted as frequency of transaction 
and. the weighted communication. ' Weiprhtin^ 
a^^nacrq c:vommunio?ition evertt of two 'minutes 
thB\ 3-15 -minute category wa^ elRht. minutes 
trar^gatiQn*s , and the average for' the over 
catecH^rv/ was 3? minutes or Id' transaction 



of 



was based on an^ * 
J The av%ra^e for^ 
or four we^i^hted 
15 minutes 
units . Thus , 



conclO^ons could be drawn from the data about the quantity 
a*s well^^s th'e frequency that interactions occurred." 



The'^AsHI modes selec ted'^'durine: this five day oeriod were 
"send m^sag:e slit^htly less for the Journal , and 
relatively rS^tle for the' shared file and " 1 inkint^" modes. 

AHI Has not foun'd to* be associated with a reductj.on in 
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paoer flow. Rather*, there was less face-to-face contact 
arnon<? Vthose usin> the System. Telephone -^tra ffic wa? also 
less, but not significantly. 

AHI was used^ quite extensively for vertical , 
•comTiunicatibn , eouallv as much as paoer base'l » • 

communications. Those who used AHI also had .a broader base' 
of contacts' than" d id those who did not use tlwHSystem* 

The data "analyzed. bv^'Conrath is certainly, not meant to 
be reoresen tative of the communication activity of the 
i . orcranization . , However, it does ppovide some insic!:ht \in to 
the way in- which the System is beoiinning to have an imoact 
uD®n communicat i,ye behavior. The study clearly demonstrates 
^. ^ that it is^ beine:* us'ed^^for the purpose of interactinc^ 

ve/rticallv* and hor ii^ontally ; in the ort^an izatlon . The fact 
that it^ seems to. have been selected in lieu of face-to-face 
irftera-ctions , especially verticallyy indicates that it can 
be us-ed- as a very personal interactive device. Whether it 
retains^the. advantages of face-to-face interaction is a 
^.questioff ^r future research. It does offer many 
• • " - advanta^S, ^such as the >ecordinq: caoab il it v , the ability to 
• ^ ' reach th-ro^u^h barriers to ord inary communication , such as 
" the req^iver's absence V^d unavailabil ity (especially 
• • * vertlcallvj , and the capability to immediately transmit . 

■ ^ A str.onf? recommendation is in order^baaed on this cross 
'section at a relatively , early stage in the development of_^^^ 
, fuiry auptmented orctanization : that a follow-UD study *be 
done in ""^ year ©<r s^!^ to ascertain the d if f erences In 
commun iqsiticMi;^ pattern and structure due to. expansion and a 
' hieh.er level of experien-c^. ^ Even though tft'^e communication 

th1-eshold wa^s T\dt passed for a ^'significant number ,of 
subjects, the si^^nif leant level of cornmunication activity 
leads to tKe prediction that a gneat .change Will r^esult over 
■ a longer time period. 



V . ^ Interviews ^ • 

• '. Interviews were conducte^i at three time periods during 
--^ the apan .0 f. .th i-s s^udy, at the out^i^of user training and 
I System imolementa t ion , and durincr the month that fell three 
quarters throu^rh the ;span . jThe orimary purpose of this 
teohnioue was to suppler^'ent the more close-ended techniques 
by alio Winer. -a max imum freedom o f response. The details of 
the pro^edur^ and the ouestions most.often^ asked are in 
Aop^nd ix 'H . , ' 

TTie ' inH:erval 'between interviews was relegated to a 



1. 
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minj^tnai: role due to tvhe problems associated with thi3\ 
method. ADDointments were very difficult to/ obtain With 
interviewees, and 'periods of weeks could pass before'a 
subject finally mad-e hinsel f ^available . -.This was corripounded 
by- the schedules of the interviewers, both of whom cane in 
from outside the organization •to minimi-ze interviewer 
impnsed --bias . The results are interestine; due' to' points ' 
that are made. However, no analysis beyond reptDrtrnsr 'end ' 
•rel^atin^T .th§m to similar findincts throueih other'At'echn iq^es 
is aooropriate. -Tx) 

Iti was reported by one or more subj^ts tha^^ addressing 
and crivinq; tlje co^^mands 4 s distractinc: Many also felt that^ 
they do not have enoue:h ti-me to orac tioe using the Systenj to 
achieve some l^el of orofitiiency. This was cHed as' a 
major -detractor. It/ was compounded by a .manual that was 
difficult to understand. A table of procedure's to follow 
when difficulties arise would 'be most helpful . In addition 
to the. lack of us'er aids in case of trouble, the more ^ 
soDhistioated comm^ands are relatively difficult to'learn. 
Some felt that it was necessary to memorize the commands to 
be free enouerh- to concentrate on the text at hand. .A 
dramatic- DPOblem was that of losinp; work or fll^s,/or beinc^ 
unable to access them> The terminal was alsora problem due 
to confusion about the special f unc t ion ke:ys , and the , - 
differences in conventions amone; the termina>;3. 

Manv indicated a 'preference for the old ways. frs 
orofessionals , some ind ic ated that secretaries should dq- the 
typing;, especially for the first draft. A lack of V 
proficiency at typinf^ is certainly relat^ed to this. The 
structure that the System offers was viewed ^as a biirden^ ' 
formattins; text hierarchically^ reouirexj additional time. 
This was related JU;^ not haviner a hardcopy to work f^^^m. 
♦ ' ■» • 

. The rnost Ximpprtant nef^ative response throucthb.ut the 
studv concqrned System availability.. There were several 
reasons for this. Earlv dur incr .-the period there were too 
few ter^iinals . Subseouently , there were too few lines for . 
callincr into the Svste^n. Consistently, there have been, 
hurrterous crashes resulting in "down-time?' , a problern that 
rena in|r. ^ •''„■, ^, • 

' Down-time is. not limited to the System as a whole*^ — 
terminals and nrihters also were reported to' fail. 
Technical orQblems associated l^ith the use^-of the orin'ter 
^and its ooeration were the inab iii ty to underline, and -'the 
lack of control over what portion jpf a (document 1^ to he 
.or In ted . - • . ^ . . . 
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A DrqbleTT! resultinrr from >the experimental nature of t ,he 
Systen was noted. Chan^es^are r^ade pgr iodic^l iy,in t,he 
commands and procedures for^usincc AHI , many oCo^Jj^ioh are .fiot' 
announced or documented . This was emphasized Vs atj 
important change that^should be m0de. 

Otjiier suggestions were that privacy should be mjyfe 
secur>e for workinp; dociimenta tion in the * System ..\ AlXh'oucsih a 
subject was pleased wl/U}^_the trainincr period , in i^ial 
sessions should^ be Limited to a $maller arid .mor^^ manae:eafel^ 
set of command;^. , ■ _ / ^. 

Positive^ responses emphasized the (jommurVieai ion 
caoabilty and movement throuc?:'h dif f erent f iXes . ilhis-'was s 
pArt of . the potential that many sub jects 'f-eQlortied later ' 
dur^n^ the studv per!iod whi^ two thirds, of the . users wer^e 
accompl ishinnr "all" \of U>^ir work .on/it* "''They fiound that 
communication with p^er^sons remoyed from the ifnmediate 
environment has- increased . In particular, several persons 
on the AJi'PA Network /were contacted and profitably* results 
0Gcurre.d which wo ul/Q hot have been possible. / * ; ^ 

Most useV.s reported ,that they could see the potential 
for increased efTiciency. > There were sor^e,. Reports of - 
in?tanc-es where the savins in time Was ^Ic^ni f icant . -Some- 
felt^ that.^ there was a liberating effect on- thetr thinkincr - 
faclli€atine the restructur inc^ of daily tasks so that they 
could 'be ef(f icienl^ly dealt withx The use of the Imlac CRT 
d isolay |f^fcs ^ important, in positive percept ipns , 'espec ially 
far edi*p!^ purpose* . In q;ener^al , the user population 
became mo.re positive with ex p^Qi^ience , an^ many of the 

necrative (Jomnents were not repeated later "in the study 

■' ■ , .it ^ 

^\ the next section will dl;S<russ', ^-summar ize , and^'ahalvze 
the results o f "^he^ combineji^m^ethodolo^yical instruments, with 
a syner»e:vstic" butcWe — providinG; additional ansisjht into • 
the effect of thisv advanced .compu.te^r system thrdu^h the 
in terrelationsh ips ' and patterns of the data, . ^ 
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' ':. ' Section VI 

- ... . . • SUMMARY AND , CONCLUSIONS 

^**Thi'S studv reports ;tne findlncfs encoripas^rn^ a seven 
month Deriod- durine .whi^ch^the AHI System was impr^men ted , 
tJsers -were trained, numerous ^ problsins we're encountered and 
overcorrie, and ;thfe orc^anization hec^a'h to evolve toward an 
Auemetfted KnowL^dn:e Workshop . . In creneral the study 
sUDDdrted the hypotheses and documented the exoeriences in 
this firsf-of-«a-kin4 situation . ♦ . • o' ^ 



; -I ' *' , ' Discussion iof the Hypotheses , 1 

Overall, > the study is .consistent with the assu^^ption 
that thefe ^ould. be ps,ychometr^icall y measurable effects on a, 
Donulation due to imnlementation of the' System. It was ' 
imnlicit V that these effects would be .of -a behaviocal or 
Dsycholocrical nature, and they were/ .However, the 
directness pf the subjecXive measures <loes not permit ^ • 
odnclusions of a "more profound ,. philosooh-ical nature. 
Sub.iects were commandeered as pbserv-ers of their own, 

Travior, the deoth of which is deoefi'dent upon their ' levei 
^f ^consciousness apd limited to the'more practical 'asoects 
of-^Umpact, X^e $ub,1ects did . consider the ora/rmatic ' 
characteristics of the new tool,' but the philosophical, 
imnlications , viewed from^this prec ipice f soc ie tal 
evolution , remained ohsc ured. beneath. the 'humdrum and flurry 
of pedestrian*- activity. ' . . , 



r 



More indirect probes were not feasible in the * ' 
•non-laboratory ^^environment with I'imite'd resources. The 
Orofani7Rtional Climate Index was orlf?ihally intended to 
^scert^in the subtl'^ a f f ec tive\ and percept ual' fluctuations 
th?>t sljould'^apoear* if '^-mare-. profound transforniation^ere to ' 
ocnur, l.e'-. alonp- the lines that Marshall McluhaTT- . ^ 

.introduced 9oncerninV mass media.. The. inst ab il ity of the 
orcrani^ation , .t'h^ methodology itself, and the continual 
compressii>R: of JLhe u^ tirive\pK^kiod, cKie to tec+inical . 
dif f i(^ult iee , li'^i'ited^ this .be'chnipue ao t^eneral population 
.escrintiqn . The QCI/was the only ava^^lable indirect ' . 
instr^um^nt th^t the^^l iterartyre ^search r^evealed and there 
were no inst runents tha.t wei^e adeouately de^ie:ned. The 
ee'neral attitude nuestkonnairB. ( "T" ) ^did ntotrdetect deeper 
chanp-es in the att 1 tucfinal structures which were expected tb 
o^Cjfe a shift' in . the jbverall DerceotioTi of. the techn'oloo:ical 
coacep>ts .(See helow^ . 

. A^fcioucrh ,a le.ss than desired amo'unt of'lip;ht was shed 

• . ■ ■ , ■ ■ - •■*'. ' - 'N- ■ 
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upon the tFTTebretlcal implication's .of this extraordinary 
technol o*cry , more was uncx)vered about' the hypo thesiz^d^ overt 
behavioral chanf^es than was antdcioat^d. 



Hvnothesis One.: Effects on tls^e Individual^ 

As hvjiJ0^hesized , the-^'cvcle* of events to reduce written 
documentation ^^ine^ flexibiity and- was rnore timely. 
Increased effioiency permitted tTie"^*4,ndividual to exercise 
more'control over the deV'elcpment of ^lis own' Ideas on papor 
and also to* .be .mojne responsi-ve to the formats and \ 
reouirenen ts Imposed uoon him, The^ factj^ that one person, wav^ 
c^ble.to complete the entire process Qf publishine;. ,a 
technical oaoer, fr^om dricclnal ideas'^to typewritten * 
document, dramatically illustrates the 'imnact on routine job 
behav tors*. ^ ' 

\ That we v/ill ever be* able to sav that! a person was more 
creative due to S'ome variably , with the confidence \o f an 
enccine;.er for example, remains Questionable . However, J in. 
this case the subjects did st^te that their thinking; was 
enhanced, that the structure added a new dimension to their 
thinking y and* that the Svst^^m orovi'ded nnemonic assistance. 
Limitations* were more likely to be ^nciounterfed at the ' • 
interface between the aup-mented and non-auc^men ted "virorldsH, 
which weVe not ready tc accept new ways of repres-entinc; 
'^onneotual relationsh.i ds" on pa^ber . The inter face 1 imitation 
will diminish in maf^nitude , ' but It is representative of the'' 
p^reatest obstacle thl-s technolop"y faces : '''natural human 
intransi<7enoe . • 



Hvnothe5?is Two: *v Effect an Groups • ... . 

^ \ ■ - ■ . ■ 

As with the hvno thesized ef f ec t on the in,d iv i3ual , the 
effect on the co.'^municatHon* amon^^ individuals 'was identifier! 
de f^c to*, but .the ide'nt i f ication of better decisions*, and 
naalitative innlloa t ions in fiteneral , remainjg el Osive . While 
future researchers >rill wrestle^ yith this nethodoloc^ical 
oroblem, We were able to clearly show behav io.ral - cjianpres , , 
not only by subjectiye judvo:ement and obsfervat Lor^ but bv 
countinc' and ol ass 1 f^vinp- communicative t^ransac^Lons . Th© 
System was used. It did <^rpv/ into an intera<^tion network 
th<i*t rivaled the traditional networks, and it did postively 
a^JTe'bfe attitude", The * Apo^men ted Knowlede:e Worker evDlved ' 
nanifes't incc a deoendence *he t^flH^nol^y, a systematic 
devel'onment "Of'^iethods for'u.*^ ir Uie System, and a social 
^milieu focused throu<^h the 'Sv.'tem^^ir r.. d Knowledge Workshop. 
The bee? inn inc;3 of a knowled^re " 'r,ro'n> were de t . table as 
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AK-Wn wor^ re. ocniTted for accomf^ishincr k'n^wledEre work where 
thev wouVd not have been, and basic worl^<^ information was 
inG.rea?i'ino:rv handled via the Systeni, as Enselbart predicted 
.(see Section 1 , d . 3 1 ) . * . . , »>• 

" . ^ ' - ■ ) 

Hyaothesis Three: Effect on the Organization ' 

Haying shown^that. com-nun ieatlon channels were rerouted 
t'hrouRiYth© Systen, and that this was perceived as 
acoept>^9^;Nj^rnonf!; rrpoups PIS an inte5rated social phenonn=enon , 
little more is necessary -to demnnVtrate effect on the ' 
orq.anization . Indeed, vertical comTiun icatidn' was 
favcil iatrfed , and inasmuch as thfe' ner<vous system of an> ■ 
brcraniza'tion is communication amons^ the constituents, the 
organizational Gestalt must have exoer'i^nced Growth. 
ManacT^nent did exercise control in the- cybernetic se-nse * 
tTTrOuffh the System of its o.wn volition, and likewise', did 
re,ceivp feetihack.' . / " 

> It was demonstrated' that ^smaller organizational units, 
or.«-ah4zations in" themselves , can aceompltsh' the ma ior ' 
nor.tion of their business through AHI, with the aura of an 
Auf-mented Workshop expandine: vertically through four levels 
of mana^^ement . But, nualitative implications, no matter how 
mdir-eot, were not d-erivable .to show the appearance of open' 
manacrement _t"echniaues with or without a loss of efficiency. 
Follow-on studies of this or^ahization may conceivabl y 'shbw 
T^ore onen vertiQal cotflmun ipat ion in comparison to this data; 
however, the- methodolofrical roadblock remains : measurement^ 
of the efficiency of manafremeht. It is analo«7cfus to'-*' 
identifvin<T leadership trai tsT^nd^ch other thin'^s which 
are ultimately \ function of indivl«ial style. ' ' 

This studv encroabhed upon a most demar\d^ne; qu&stion- 
facincr students of organizational behay^ior: 'which of "thfe 
two forces that coiiprise an oreianization , the individual 
Personalities, or the structurally, imbedded opQrations',. the 
"svste-i ', qpe more powerful? AHI has.,been demonstrated ' to 
be, as a. mini'T'um, a tool for accomplishing; the imbedded 
ojoerations of an ort^an i^^a tion . But, in relation to all 
ather variables, individual personalities appear- to be 
resnonsihie for the nrenonderahce of influerr^ on the dei^re^ 
to which nositive e.ffects can be realized. « . 



Individual Differences 



The consistency, of the data across the <1ifferent, tests, 
nuestiohrfair«es, and observations for individual Ejects wa's 
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of na1or rnethodaloo; ical imoortgnce. It also hiqhli*Q:hts the 
iridiviHual differences variable. An examination of the 
DODulation profile, both :1ob task, t^ype and the derno^raphic 
.factors (see AnAfijndix A), and t-he System userj s scores (see. 
Anoendix J) did not reveal a^iv relationships/ ^ 

It was exneoted that^aj^e, technical soecialtv, job 
tasks, and other factors would be a Qc^nn i A-t^^^H^Ujji t;.h a n^qatiJir^ 
set of resDonsej?, for examole. Although the DopuTation ^ize 
is small, we oan be reasongblv certain that the copulation 
characteristics did' not influence the acceDtance and 
utilization of the technolocry. The quest ion^ remains , why do 
the differences detected i^DOear between subjects? The only 
remaining factor , resDonsible for score d i f fepences o f up to 
tfhree standard deviations, a-Doears to be indiviclual 
difference-. .5 " . » 

■ • - • • • " ■ .■'i' 

The "^adnini^trati^on o f a > oepsonai ity inventory was 
.on5udererf initially; .hqwever / the resistance of the 
Donulation to such a test made it orohib i t ive . The ^ 
^Activities Ind ex^ (.Ster^n , 1<57Cl) 1:5 an -instrument that' 
'^ote^ntiall V could be iven -early in the evolution of a 
Workshon fof 'latpr^ combarison wi'th the acceptance and ' , 
utilization'' o-f the System for each subject. The stroncr 
force that individual oersonality renresents is a delicate, 
are;^ of invent iVation , but one th'^^t must be explored if the . 
System is to . be in terjeo-ted" into a working environments 
with , a r-e^sonaMe^^^lement ;of predicted^ success. The 
economJj^^^^^F^ c^mouter au«?^men tat iom m.ay encouraf^e the 
utilisation dsf ner^sonality testing as, a prereauisite for\' 
implem^ntat ioT 

Rffpnt pn General . AttiUl>^ Toward thp Technolo<2:y 

'The tes'W instrument designed to detect th^ more covert 
pffects th4i/were hyoottiesized ,apnears ,to be invalid, an 
ir^nortan t/methodloftical f indincr . There was no si^ini f ir»an t 
d i fferejpKce between the mean attitu^fe of the crrouDS toward 
the Re^eral teohnolp^y. However, .all other findincrs 
stnoncriy 'suDoorC «oncl usions ^ about effects. ^ Therefore, it 
must be oonol.uded that the test instrument was not sensitive 
to the effec^ts of the AHl System on this ^mall samble . It 
indicates that measuring the attitude toward a cteneral 
tecbnolofry mav not' b'e a reliable rrj^ethod of ascertaininp; the 
soecific effects on a -small nooulation. The consistency . 
bejtween the behavior and the responses to the other 
instruments did; however, ooint^ toward str^ons; reac ti ons 'to 
specific aspects of the' System. 
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The Progression Toward Aut^nien tat ion 



i 



There were ^^mepous findincja Qomfernin^ the process of 
» evoluti^on toward' full augmentation, which was reached by 

aprpxiTjiatelv ^ percent of the user population at the J||me 
. this st\udy was concluded. * - ' 

■ \ ^ • ^ \ 
\ i A sTr^eat degj. of inert(ia favoring retention of the 
current modus operarjdi was found. The routine work methods 
were ingrained to the hab it level , and required some 
extin-Qtion and adaptation during the learning process,^ 
This, t^oCfpled with U^e usual vl^re^ec tion phenomenon," could 
have» prevented tj;;ansitUon to ytj^Kment however, it was 

.possible, to overcome tnese obstacles in. this working ^ 
environment. « \ ' v . 



Thre3hclds were discoveret^ pdat must alsoxbe. passed 
durri;|g the individual's evolution. Initially, a sy^oTrg-^ 
tenrjency tp use the System as an automatic typewri^-p for 7^ - 
text, ed itinf^ was observed for most subjects. ^' After ^ m\ 
attaining a c-ertain levQl of usa/e and' profit ienc'y , subjects 
'crossed tfhe threshold to usa^^e for on-line composition. 

• A- marked psychomotor development. System transparency, 
was concommitan^ with on-line- <:oiilposi t'ion . Subsequent to 
this .development ,^ a threshold ;ln the learning process^ the 
individual dealt yith the mateVial an^contenfe at hand not 
burdened%with the Kistracting thoughts \bout procedure and 
.System operation. This tended to free h^r!^^CQ£^JaftQn taneous , 
creative work while the rules of operation and syntax 
rema|J.ned ^ subl im J[^n^a-L .in a way analogous to the use of 
lancruae:e ih conver'^a tion . "it was noted that the command 
langua^^e is particularly suited to this due to its ' 
similarity to natural ""language . Prior to passing through*/ 
thi.s^threshold , sub jec ts woul^J report a considerable loss of • 
efficienayl When the threshold was passed, it was found 
that the hypothesized effects were realized for a majority 
of the poDulation/ , ' ' ^ 

^ The . individuals reoorted synd demonstrated incre'ased 
effectiveness. Effectiveness inclfudetf an - increase in 
«fficiencv-r which was reporte/1 ' as a reduct ion,>^in throughput ^ 
uime In this context . '-.Ho we've r , there was no increase in 
quality baqed on su^b.ject judgrnents. Nefth^ was there a 
\ loSs in Quality.. The oarticular test items, wMch reouired^ 
^that thi5' 'individual, evaluate his " ov^n work , are probably not « 
*a valid indicator. A more indirect instrument, such as a ^ 
semantic differential, should be considered for future 
investiga.tions where quality is of interest. 
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The- display subsystem was found to be, more desirable 
*.cin the teletynewriter subsystem. ' Certain Individuals 
found that it was vastly, more effective, and there ^as some 
feeliner that full auc^men tation could be realized orMy * 
throupjh the display subsystem. Its power should be 
available to aiL users, and it may actually be easier to^ 
learn ^as indicated by the few subjects who learned to. use 
the dts'play subsystem ~^QLj3ly. ^ 

Proficiency was foun^ to be a^ function of intensity of 
use, rather than longevity with the System. All persons 
motivated to maintain a r^gulgr Intensity 'of use were able 
to become pro ficlent • regardless of aptitude or experience. 
Intensity was fTecessary to retain skill as well. The 
proficiency test also showed that an alternative editing 
technique was mor^ effective: ^execute edit. ^P):^o^^c ie^cy 
was closely associated with the learning thr-ei^Qld^^ to ^mbre 
so Dhist i6ated augmentation, positive oerc'eptions of the\ 
System, and the amount of cpmmunicat ioJi. fac ility usac:e. 



, ^ Effects 'ori • Commun ipation • ^ 

Th^ communicatjlon facilities were used with -^increasing 
intensity throughout the study* period Of these, Send 
Message was used most extensively^ Jownal a close . ' 

second, and shared files, and linking 'we>e^3ed relatively 
little.' The Journal was not used f*or djaldi^4^ support but 
rath'er sepVed to send 'documentation and messagVs^ The ' 
Dositive responses about the effectiveness of the"'''^^^^^ — 
^^mmuni'cation facilities corresponded to higher use •levels. 

AHI did enhance "team activities around a^ common task; 
hioweyer, it' did ncft affect in^tergrouo communication or 
engender any positive trend ^toward more ideal group' 
dynanica. Communication through the System was dependent 
upon need , much as it is through traditional channels. The 
scoDe of the on-line community was important a sublet of 
the Dc!rtfulation did not have as lar^e a groap cff on-line 



r^cioients as others; Some 



omm^inicat ion iqcrease among 




peers was related t,o the "conmom enemy" problem, i.e. the 
Svstem was a challenge to al . users generating discussio 
about common problems. 

Some^ charinel i5 were opened with persons who otherwise 
would not have been con tacted . The System provid.e^J the 
Informational incentive and made the contact possible. AKWs 
in p-eneral were found to have a broader base of contacts and 
more timely transactions than the control group. 
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Recommendations for Auc?mentat ion 

The more oractical findinc;s provided the basis for 
establishinc^ certain prerequisites that seem necessary for 
the individuar to bec^in to become an Augmented Knowledge 
Worker. The prerequisites ^are based primarily on subject 
responses, the pro f ic iency exerc ise , and observation of 
behaviors. It . is recorwTended that they be tnet whenever 
computer systems are to be employed fo'r the daily 
accomplishment o^kn'owledqe wofr^k. , ' , ' 

The necessary hardware must be avaiable and' in ' 
dependable operation. The lack of this had a negative- 
effect on those who were trying to learn, under pressure, 
and pafticul^ly those manifesting an attitude below thfe - ^ 
mean. In a minority of casas this" had a at ronc^ , deleterv±6us 
effect. The unavailability ^f terminals and the inoperative 
printer wer^i cited most often as negati\re factors. System 
down-time remained. a major obstacle throughout the period, 
eveh> though down-time Is eha^r^ac ter isti-c/of experimental 
systems. At least every effort must be made toward Systam 
availability at predetermined times. 

Introductory and self explanatory documentation is 
necessary.- The lack of a referei^ce manual and a "what to do 
in case of" trouble manual oosed signi^ficarft problems 
initially. The numbed and variety o f operational 
dj.ff iculties and failures require that an extensive 
reference manual be made available at the outset of, usage. 
Many of the-'se problems, it should be noted, were w^ith the 
ARPA Network and involve retain ing- a connection to the 
System mainframe. 

Train in^^ could^^help solve this iproblem and could 
relieve much of the initial frust ration ^ that was'notecl. 
Supported by reference materials, small 'olasses , and a 
structured course., training could speed the individual's 
progress. Jt, was ^found that highly .mot ivated subjects could 
learxn with minimal training; however, the negative reactions 
of others were prohibitive in some cases. " v 

Training must .include some indo'fctrination' about the 
Kurpose and' definition of the System. It was fo.Und .that a 
minority of the subjects understood the conceRt^ of full 
augmentation, which appears to be necessary to realize' the 
full System potential^ for any individual. Experience with 
previous computer technology interfered with this 
understanding, 1 imiting usage to text editine in. some 
subjects'.' ' . 
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It was demonstrated that canaistent effort i? required 
to become proficient on a basic level'. Those subjects who 
had laoses iri use exceeding a week were markedly less 
proficient than subjects, with similar "lonAensi ty" . Some . 
of this'-problem .would be alleviated by allfatincc a specific 
daily time period for practice. 
} 



♦ The , sphere of available support personnel for the 
individual was found to be v.ery in f luential . For 
indiyidua^Ls 'who responded most positively, this* was found to 
be p^omposed of manap^ers also who were users, and pedple to 
helpi advise, console, inform, repair , .mainta in , etc. 
PoiSitio^a should be established to ensure thatr persons are 
responsible for the hardware, software, and training, 
particularly- keepincj users in formed about chanc:es in command 
lant^uacre and other operatinc^ functions. i 

Standard operatinj? procedures were found to be' 
necessary to establish what tasks should be done on thfe 
System, and the structure an'd methods for accompl ishinr? 
these, ta'sks . Additional research will probably be -necessary 
to establish these procedures and answer some of the ' 
Questions raised:) , . 

Recommendatio^ns for Fu?*ther Research . 

• < There is a high prob&'b 11 |.ty that attitude will be an 
irjdicatbr of Sy/siem . ef f ec t^iveneas. for a prospective 
individual user. ^ Those subjects whose responses to 
questions about ef fee tiveness , antic ipated attitude and 
retrospec,tiV6 attitude wer^e significantly below the mean, ^ 
^Lso did belcMw average on the pro fliciency test (see Appendix 
.J). -Although it was not ^statistix^ally signif lean t , 'She > - 
general &tt*itade, toward the tl^chnology was -arso lower 'for 
these scibjects and for those who were scheduled .to be users 
6ut never initiafeed use 'beyond the trairfing sessions. Thus, 
atJtitude pretesting as well a« testing individual 
diffe rences ( discusseid above ) coutd conceivably be employed 
in,'.a reoulr^ments analysyls to determine AHI's applicability' 
in another env/Lronmen t . ^ \ 



Personalities are such a significant factor in System • 
use, as discussed above, that extensive inArest igation * 
correlating personality with System utility would be of 
great value. In this specific case, the OCX should.be given 
in one to two ^years to ascertain the effects on 
ore:anizational climate, which -Is based, oh aggregate 
interactions of personalities and their environment. It 
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should be noted that it is not necessary to compile data on 
indiviclusils if this is offer>siVe. 

. • . ^ . • . . ; ■ . <^ ' 

The Communication Tally analysis should definitely be 
^osttested^^The time frame should" be similar to that, for 
he OCI; broweVer, it is necessary that the entire, expanded^, 
ODulation pass* the commun icatipr). threshold". It i^^at this" 
Doint, where the individual has experienced on-line 
camposit io'jn , Sygtem transparency) and has a substantial 
'onVline^ communj^y , that we* can ouantify his communicative 
behavior with 'valid results. To wit, the examrttration would 
be bf the true AKW. " « , . 



• Overv ieW' » . ' 

TheVnual itativ^ aspects o f the hypo thesized effects 
.were • not' entirely substantiated ; ho vTfev-er ,^ th^y may be, with 

^^-.tjonal tim'e , methodolocrical research, and System 
riev.elonment . As this study shows, the population 
exDerienced an uncw^eceden ted f lexib itity and involvement, 
with textual information thrlou^h the ut il ization 6 f powerful 
aucrmentation tools . . ^ ~ 

\' ^ ' • ' t \ ' ' 

* The tools facilitated the construction Sf»a dynarffi'c 
information space wljiYch was shared with the on-line^ 
commumity. The (coinmun icatiojn facil ities were employed to 
create nev/ patterns of co^*»municatlon ^ that would not haye 
been attained ^rbuc^h al<terr?iate means*. The rfesultant%, \ ' 
documented tean collaboration , extended to the orc;anizat ion . 
Vertical communication was modified, as -new channels Were 
onened and 'formal . channel s were al tered from the traditlon^al 
Da t terns . / f . * . ' 

The subjects' exoerience was analogous Xo ^travel in<3r 
throuPTh the dynamically structured information space of a 
eieoerpaphicaily distributed community of knOwledq:e workers 
with such rapidity and ^ease [th^t^ it was almost addictive.. 
The dramatic, chanties in the work* methods and communication 
within this >poDulation , In the/ tim.e span of seven* months, - 
indicates that Peter Drucker's "knowledere revol ut ion" wil 1 
arise from the use of systems such as AHI. At least for a ' 
DODulation o if f^overnrtient scientifi c and fing;i nppr i no; 
nersonnel , AHI's potential is bep; innino: to be realized as 
that which it^'s desiorners ^at SRI .intended : a revolution in 
the^ communication process* in the broades t\.ser)se . 
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APPENDIX A 



SUBJECTS 
S 1 2 



JOB TASKS* 

Si-:' ^ 5 6 



POPULATION PROFILE D|.TA 



8 



DEMOGRAPHIC FACTORS 
lO.SER AGE- POST iRANK 



USERS 1 
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"2 0 
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3 0 , 
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23' 
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15 


20 


Q 


15 
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"■ 0 


15 


0 


24 
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•PHYSCI 14 


5. 20 


5 ■ 


.'•20 


5 


.10 


5 


5 


5 


' 20 


5' 


6 


31| 


EE Ij2 


6 0 


4 5- 


M2 




10 


2 


0 


1 


* 25 


0- 


11 




EE 12 




70 


5 


0 


5 


. 5 


0 


0 


• 5 


0' 


17 


37 


EE 13 


Sf 50 


5 


10 


"0 


5 


•5 


0 


5 ' 


20. 


0 


.6 


39 


EE CAPT 


9^ 0 


0 


0 


20' 


• 0 


0 


0 


30" 


0 


50 14 


43 


CLKTYP 4 


USERS 


• 

2 












, 
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1 0 0 


10 




,5 


% . 

J 


J 


0 


- 0 


1 2 


0 


15 


38 


EE • 13 


110 


■15 


25 


20 


3 


2 


5 


•?15 


-M 


5 


6 


29 


PSYC CAPT. 


12 60 


20 


0 


0 


0 


5 


.0 


5' 


10 


0 


1 1 


35 


RESPHY 12 


13 25 


25 


10 




10 


5 • 


0 


• 5 


10 


0 


7 


29 


EE 12 


lA 15 


45 


5 


A- 


5 ; 


. 5 


P 


,5 ■ 


5' 


0 


3 


25 


EE 9 


15 0~ 


■ 20 

> 


40 


0 


10 


5 


5- 


5 


id • 


5 


12 


33 


'EE 13 


16 5 


5 


'■ 10 
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20 


4 


35 
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20 


:0 


> 29 


51 
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10 


10 


10 
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5 


0 


0 




0 


27^. 


55 


RESPHY 12 


18 10 


2 


2 


10 


1 


1 


0 


1 


72 


> 


^3 , 


25 


EE 9 


37; 0 


10 


■■ 10 


10 . 


10- 


10- 


10 


10 


30 


0 


23 


54 


PSYCH 14 


^8'.5: 


• la 


10 


0 


3(5 


•0 ' 


40 


0 


'5 ■ 
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20 


43 
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u 


u 
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c 
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20 


55 
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. 5 
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0 
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NON-/IJSERS 2 
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SERV = government'*" ser*»Vice tirn,e)in vears^ ' 
RANK r Civil ;g^rv ice . level or rank if military 
.POST = Positi/n if a. manaJi^r, or soecialty if technical 

EE Eleotrii^al Encrineer / * 

.PHYSC = Physical Scientist ' - 
RESPti =• R/search Phvsifeist 
CLKTyP =/clerk Tvpist 
PRENG 9^Praje6t Enrrineer 
PSYC /Psv,cholop:ist . 
?HyS0 = Physical Scientist 

iDM s Pro<?r3m.. Administrator . 
Assistant En^ ineer 
Mathematician " 
Division Chief 
PRCH =. Branch Chief 
SECCH = Section Chief . /. 




AGE 



in vears 



*Job Task. Tyoe.s (^enerfal categories of job ac tiv ities tha 
are aocom'pJ.ishe'J bv \the PoDulation): 

1 = Profrramnin?^ . . # 

2 = Pro-iiect enc^in^erinR , ihcludinG^: 

contract paperwork (forms memos, etc.),. ^ 
reviewirifT proDosal 5 anV reports ' ' 

. 3 '= Writinp" plans and/or\reports 

4 = Softwj^re opferat^ion (iVcl. ^valuation 

5K>ftware / 

.ackapies) ; 



debUf^rjTino; of 



Briefinf^s / 
Demonstrations of system j 
Manaciincr ,o'therf personnel 
Administrative paoerworX 

Study , yeview[of the sta^e-of-ttie-.art , read'inf?, 
literature^ / . 

Larc]>,/ etc . 
10 = Secretarial ^work 



6 
7 
8 

Q 
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■I 



f 



■ ^ 1 



Instrtictions : Riaqe pencil m^ark in^ the place oa^Hv 
/ answer r^hieet that 'nost'^accur/lely rel^resent^l^yo^r 
Dositic^; v'Pj/ease ansvSrfer ALL .quesHons • 

1. In cjenef^ , automation is' a fifobd- 



IS • • J 



strontl?' airree 
disac;ree 



b) a^ree ^ ' > 

(d) 3tron«;lj\ disa^tree 



2. lAiitomated lib.^a.iriesf ,are extremely useful because of 
the information explosion today. 



(a) stronc^ly agree (b) 
(c) -disagree * (d) 



ac^ree 

stronsjly disa^^ree 



*3^. ..A compuCer .based- library, fpr retrieyirij; ^11 
information that I use^^ln my daily activities would, be 
a useful aid to^tne. v^. ' - .■ y '* 

(a) sbron<^l jr. aereie "^^^ Ji^Y agr^e ^ - 

(c.) disaccree ' . stroneily (jisaoiree 

4. I do. not enjoy Afiorkin0:'u%ih computers. 



( a ) * strongly agref^ 'i, { b) 
Ic) disarrree . *' ' , . (d) 



acrree 

strop^ly 'disagree 



5.1 would'^not tru.st computer storage 'of Dj^perwor^k 
that I use dailV. ' " : , ■ * 



(ah strdrisily aerree ' (b) 
(c) -disacrree *. (d) 



agree 
strongly disagree 



6. . In general j cbnr>uter3 are reliable. 



(a*) ' stroligly aqrree 
( c ) ' disagree 



(b) agr^^ : ^ • 
(d) " strongly disagree 



7. Comouters can save a lot of personnel time when 
apolied to dailv work. -V , . 



(a) strongly agree- (b) 
(c ) disagree ( d ) 



ag,ree 

ptrohcrly disagree 



8. If ;a program were wr»itten and de-plOyed to handle my 
^aily paperwork i\t would be of ti*emeadous advan^tacre. 
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(a) < ^stronpljy §gree k^^) a^re^ 
Ic) I disa^t^de '(b) st,ronc;ly disagree. 

9. Privacy/cannot be maintained for information stored 
j ' iff computers, ' - ' 

(a) stronf^ly aprree (b) accree 

(c) disactree • (d) strongly disae^ree 

^^6.^ I'^would not be boftfiered by a lack of privacy if I 
, used a computer for all my daily paperwork ( i ^e , -my 
• fellow workers would have a*cces3 to all my written 
work) . 

(a) strongly a^ree (b) agree; . 

- disagree ' (d) strongly disagree 

11. I would not mind enterlnt? all my written work ihto 
a comDuter system fpr^ future use^by myself and access; 
by all other persons usiago-^ the system • 

(a) stront^ly agree (b) at^ree ' ^ 

(c) disagree ^ (d) strortgly disagree 

think^'that handwriting work for typing or far my 

own personal use on the ^lob is a primitive method of . 

doings things . ^ , ^ 

(a) • strongly agree* \ (b) agree 
Cc) disagree * V' (d) strongly disagree 

13. I would find it advantagveous to be able to store 
/ and then retrieve for future use, oaperwork andl other 
- wr;itt?n material of routine value tq me.' 

' (^) strongly agre^L "(b) agree - • 

(6) disaprree V (d) strongly/ disagree ^ 

^. 14. A software system that would essen.tiaj)ly replace 

the paperwork activities of my^^ecretary would yiot be a 
siftnificant improvemeht over, the present situation, 
• ' i-' ' . ^ ' 

:. ^ ' ~ (a) strongly at^ree (b) agree ^ , 

(c) ^ disagree / ' (d) stront^ly disagree 

' ' ' ^ . 15, ;rypa^«t my own^paperwork a computer^ system 

, ' "^ould bc|tt?^r me^^ 

] , (a) stronf^lv as:ree (b) agree 

I V (c^ disagree . (d) strongly disagree 
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16. *^ Computers are excellent for jpirogr^amming and 
subsequent processing of prograrms^ ^ 

(a) sttrongly dgree (b) ^agree \ 

(c) disagree (d) strongly disagree 

17. Computers are excellent for loa(ling, storirtg, and 
manipulating textual information (eg. letters,, Dian,s, 
reports; etfc.). ^ ^ 

(a) atrongly agree (b) • agree 

(c) dfisdgree (,6) strongly disagree 

18. ComDufter technology * is not at, a point where it can 
Droyide a Jpervice Jto non-programming personnel through 
the u?e of| on-line terminals, 

; (a) Is-^f'ongly agree ^ (b) agree^" 
/ (c) |disagree (d) strongly disagree 

19. Thinking could be aided through the use of an 
on-line opmputer system given the appropriate software. 



(a)jl strongly ^gree (b) agree . - - 

(c)| disagree (d) strongly disagree 

20. A computer system that was installed here to' be 
used in plac^ of pencil and paper .would receive 
excellent acceptance. ' 

^{a) strongly ac;ree (b) agree 

(q) disagree (d) strongly disagree r 

21 • The average 'Person does not have tl):e^patience to 
use a comTJUter ^^tf^ccomplish jobs that have due dates. 

(a) strongly agree (b) agrree ^ 
_ - (c) disaccree^ (d) strongly disagree 




22'. Most f rWrs in the bperation and . service of 
on-line system^ are due Itp human error. 



(a) strongly agree (b) agree 

( c ) disac^r ee , , ( d ) _ str^ojii^ly d isagree ^ 

23. A person must have a sound ba^ic undeV?standing\ of; 
comDuters to use even the most elementary orogram -wxth' 
success . • / . . 
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Ca) /stronejiy accreel ' (b) '^acfree ■ ''^ 
lie), disagree (d) ^ strongly (l|sa?ree 



•24,' ;I" think it is miich better td enter text into a 
•cbmputer where it wotald be available for revision 
# rather th^rn having a secr'etary type a new cotjy every 
time rev isi^rH^ are inade.-^ ^ - 

ta) : strongly agree (b) agree 
(c) ' dis^gr^ (d) strongly disagree 

* 25. Using a computer as th'e medium through which to' 
interact during, conferfences would hot be an .advantage . 
over direct interaction without computer assistance. 

(a) strongly agree^ , (bj agt*ee 
" ' (c) disagr^eV.. > (d) strongly disagree 

26 • Having a ^computer terminal at^my desk for use at 

my convenience wouLd b.e tremendous. . 

* ■ 

(a) strongly agree (b) agree'y^ / 
(c) . disagree ' " (d) strongly disagree 

.27. . Text editing is an excellent application of 
^ computer technology, . ^ 

> (a) strongly agree (b) -^gree 

* (c) disagree (d) strongly- disagree 

2S\ With the. great cojtnplexity of problems toda^y the 
decisions maker could well u^e a computer (appropriately 
. programmed) to present his t'houghts to others.. 
/ 

(a) strorigly agree: (b)^ agi^e *" ^ x . 

(c)^/di3agrrfee (d) strdq^gly disagree* \ 

29. Meetings would be greatly facilitated by -having an 
a^en^da displaved/on: a TV-like on-line terminal . 

V , |(a) strongly agree (b) agree 
^.^^(c) dissagree Xd) strongly disagree 

30..^ Using^ a TV-like terminal as a "blackboard with 
mejfnory" duY*ing mfee.tin^.s would increase the prodtrt^^vity- 
of the meeting significantly . 

(a)' strongly agree (b) agree ]^ ' 

(c) disagree' ^^ (d) strongly disagree 
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CoTT^rit fiy^ (and percentage distributions) 



\ 



'fSSB^S'^ilF^^ "SE OF THE Au/m-ENTED hAmAN 

IN.mtEC J' SYSTEM : We 'need to krfow your Specific dpinion o.f 

to hfelp us determine its effectiveness. Ti\y . to allow 
•^T u the System has\been exoerimenlal and. will 

"° iX '"^ ^ervioe until the Fa\lKwhen the Ut^lityxis 



■\ - WSTplJCTIONS:; 
of- -each st^iter 



Please rate the appropriat.eness-Zcorrectness 
V ...u aelec tint; t^re best answ&r and raarkine 

% '^JJ^ the aftswer sheet provided. Answer ALL 

S .aye^tions . C6nnents on ^ach of th&*a?u6stlons are welcome. 

The AHI. Svstem is. everything it^as supt)osed to be. 
/V.^ " . - - . ■ 

y, * • . 35. 53 ' . 6 . . 

,aa) .gtrontrly (b) ac^ree (c) neutral (d). disagree / 
V '* aere^P ' ■ ' ■//■ . 

disagree - ' \^ . , . ' / 

.^2.; : me mone lyl^e the AHI System ; the^ more 1 like it • 

/i-V X ^^'^ 53 * 23.5 , • '&-\ • - : 

•'ta,) strongly ( b). a^rree (g) neutral- ' (6)^ 4isHree > 
- ac^ree • * ^ . x . ~ . . 

• (e) stron<yly / * ' , 

; ^ ^ disagree . S * V * 7 . 

/ 3- The ftota^t^roui^ time for* my typint? (time to final 

cooy) 13 suljst^ij^Ually' less with. %he system .( ffiven 
/ everythihcr is rtinnincrO . . ^ ! . ^ - 

, "l^ . 5Jr 17..5 ^ 17.-5 

•(a) stronfTir (b) atrree (p), neutral (d) disagree' 

.0 , . • ■ ■ 

(e), stponccly ' 



di/sa^r/Be 



-i!' I hay^jlled D^h-cil and pa^oer -tnfjch less sinbe' I learned 
t how to-{ife^ the AHt System 
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6 • , . M7 29 • . 18 

(a)^ stconsjly (b) apcree (c) neutral (d) disac?ree 
acree ♦ > 

. • 0 * - ^ - ' * ■ • / ' A 

e) stronely . 
disagree . * 



5'. The only reason I would not use tbe AHI System^ is 
because I do not have material to be wrltten/orepar'ed . 

0 29 18 ^ 47 ' 

(a) stronccly (#) /acree (c) neutral (d) dlsat^ree 
aecpee . < ' •■ 

6. ' ' • . 

. (€l) stronccly 

dlsat?ree . • 

6. I believe, that my work is of hijj^r quality\han it was 
.prior to the^insitallation of the AHI System. 



/ 
/ 

/. 



18 ' 6 76, ^ ' ^ 0 

(a); 8troii<?ly (b) a(?ree (c) -neutral->:Xd) 

0 ^ 
(e) stroncrly i , 

disae^re^ , - 

7, I think I am more efficl6rrt- and therefore accomplish\ 
more in the same^ period of time than I did before tbe AEi ^ 
.Systen was installed. * • . . ^ 

18 29 35^"' i , ' 

(a) stroncriy (b*) acrree (c) neutral (d) disa<^ree • 

a<^ree • \i " ^ - , 

' 0 ' ' • ' • ' 

(e) strontrly 

disa^^ree 

8. /My experience has beeal^imited so far, but I expect that 
my opinioa will be more positive with additional usac^e^ 

. ^. " ^" ~' • 
^18 53 23 V ^ \ 

(a) stronf3^1y. (b) ^icree (c) neutral d) disagreev 
, ac^ree 

• . 0 - ■ \ .^ -^ . ' . ■ 

(e) stron<^ly ^ 

<1p.sa^ree , . - ' y - 
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9. The AHI system is' an advance in the state-of-the-art . 
# 

18 i 59 23 .0 

(a) st^ro/icrly (b) accree (tf). neutral . (d) disa<?ree 
acjree * . , , 

0 \ ^ . . . . 

(e) stronrrly - * . 

• disaj?ree , - / . ' 

I. 6. I think , AHI wil^improye my effectiveness in almost 
everythinj; I 'do that is job related. 

6 . . "\ ; 111 • / 111 _ 12 

(a)^ stroncrly .(h) a^c^'ee neutral (dj^disagree 

ac^ree 

-.^ A 

(e) strongly. 
' disa<rree 

II. It .is unnessary to- writfe o,ut anythincr' when the AHI ' 
system is availablfe exceot for^ thin^9^1ike ^routine fo'rms. 

0" ' . / [29 . ' 

(a) strons^lv (b) acfree (c') neutral (d) disaojree 

• ac^ree * ^ ^ 

{^) stronerlv 

\ disaccree . ' * . ' 

^ - ■ r ■ : 

12i AHI will result in increased effectiveness for anyone 
who\ uses it to accomplish his' paoerwork activities. 

. *" 

\6 . . 53 . * 29 12 
(a) ^troncjly Gb> actree « (c) neutral- (dl^disafsiree 

^prree > . ' 

■ ^ ■ ■ : • . ^ . ^ . 

(e) sironprly 
di\sa^ree 

• . , ; .V" • ■/ . ; _ • 

13. AfVter a reasonable amount of training the hyeraj?e 
person c?an use AHI with relative ease. . 

18 A ' . 70 6 ^ 6' ^ 

(a)' strorVly (b) ae^ree (c) neutral (d) disaocree 

aeree 
.0 

(e) stronqiy 

disa*?ree * 




Bair: AKW Eyal\uation f*- ' " Page 103 

\ / 111 




^ -■ ■. / * ■ ■ ■ . ■■■ ■ / 

• 14. The 'system Is effective for all thQ kinds of tasks I 
pe^rforTn^pn thd job.. / / • . * * 

0 ^ /• 29 • 2H / . ,41 

(a) 'strongly (b) ac^ree (c) neutr*al -(d) disacjree 

f 6 ■ ' - - ■ " ' ■ ' ■ 

(e) strongly . <, • \ - * ' 

. disapfree » * ./ 

• ■/ , _ ■■ ■ . 

15. AHI enhances hy ability to think about the written work 
I am doine on the svst^m; ^ ' . 

12 47^ ' . 23 18 ^ 

(a) stroncrly (b) agree (c) neutral (^) disac^ree 
ac?ree 

(e) stronc^ly 

disagree ' 

16, File sharing *freadin<? and/or writing on others files) 
is an effective way 6f keeping informed . \ 

: 41 ... ' 47 ' 12 ' 0 

(a) strongly (b) agree (c) neutral -(d) disagree 
agrfee - ^ " • 

0. . : . . ■ „- . 

(e) sti^onply, 

- disagree 4/ ' 

J 7^ The Send Message feature has been a useful tool for 
communicating with -other users. .--^ 1 

18 . 29 47 / '6 

(a) strongly (b) agree (c) neutral (d) <JtfBa^nSe 
a«^ree 

0 . , ! 

( e) stron^«?ly * * 

disagree / - 

,18. I have been ab*le • to Interact with other' users more 
~ readily, desnitfe geograpl^ical distance irf some case5^. 

/ 18 ^* IB 53 ' / '1? ... 

/ (-ah) sthonprly (b) a(?ree (c) neutral (d);disagree , 

* . agree • ^ 

■ • 0: ; ' . , ~ , . 

<e) stnfbngly ■ V - . y ;; 

: disagree ' . ' ' ; / 
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19. Better training and/or traim|t?Ji»^t^rials would have , ' < • 
improved my ooinion about AHI. Ip ' , • . \ ' 

2*1/ ■ 53 • * 18 m \, ■ e . . 

(a) stront^ly (b) .a^ree Cc) neu^|feli (d)- disa^^re'e. • ' " . - 

_ecre6 V ' •.If [ 

(e) ^tronqly . ; ; . , ' . ' / 

disastree . ^- / > - , , ". > , . 

' / ' /) '.'Ji / ' ' ^ ' 

INSTRUCriONS: Please select or/ prq(#de the best ^nsWep- and • ■ « 

mark it on the answer sheet. ' - 

/- ■ . ; In--': ' ■ ■ ' ' 

20. Which tgrninal device do yoa f|Lnd the m^lst effective to 

use-?. . ^ ; ' .. 

! ■■ ■ . ' ■ ' " 17, . , . ' 
~ °-(a) execuport (b-) iMLAC CRT* (c ) HlBM . Seleptfic " 
<dj teletype ( e ) .other--speclf iy . , . 

21. What Dercentaj^e of the time is a terminal available for 

• use?- . ■ ^ ■ . /. . • 

53 ° . 6. . ° 12 ' • 12 / V 

'(a) 80-1.005t (b) 60-795S (c) ^10-59^. Cd) 20^9? 

'■ 18 , * -.' ' . ^ m 

(e) le!3s than 20^ ' •• / . .\ 

'■ 22.^ - What percentage oif the time is th*"^ 'AHI , system avail'abe 
for use to you if all hardware is up? 

^^^^^"^^^41 , 2i| 18 ' "12 r 

(a) 80-1005? (b) 60-791 (c) ^0^59%, Cd)'20-395S v • 

6 ' . . ■ > . 

(e) less than 20i& x . ' 

23. How ^any hours a d^y on . the averaere do you use the AHI 
Systenir \ 

' . .• ' * ■ . » ^ . 

.29 29 , •• 2i| 18 

(a) less than 1 (b) 1-2 hrs (c) 2-3 hrs (d) 3-^1 hrs 
0 , - ■ 

. (e) more Chan 1 hrs (/^ 
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Aopendix G 
Proficiency Exercise ('^'•''1^)^ 




J; 



JWSTRUCTIONS: ;We would like' you to create a file ; 
called EXERCISE, Copy all of the file called copy from the 
HADC directory into, it, and then edit it to look like .the \ 
clean version that follo^ws. At the^ same time, we would Tike 
tb , have you answer the questions tliat are posed , Wherever . 
Question riarks aopear .( ? ) fill • in the' appropriate num,ber for 
you. Where dashes occur — substitute an X for the, set that . 
best indicates how you f^el. Thank you for your ' | 
cooperation. As soon as lyou besu^, tyoe a control T to 
record the" computer time on your h^ • . 

the clock time thatVyou record manud^lly ) 

To accirrately record the time necessary to complete th« 
entire exercise, type a "control . T" before you create the^ 
EXERCISE filev and aft^er you* complete the tgst exercise- item • 

We. would like to know what commands and procedures ^ ' 
oeoDle are usimt to apaomplish tasks * like this exercise. 
This will help us in the traininc;, sessions for the next 
grouD as well asVocive us some tns/ight into what parts of the 
-^HI lancugoie you^are the/riio^st comfortable with. To aid usj 
irK^this please crdve your B^teeuoort hardcopy of this exercise 
to (^ither Bair or Stoij^^ . ' , ' ' ^ 

UNEDITED TEXt that is in < RA,DC , COPY , ) : 



We would like ya to do some spAcific thihccs with the 
followincc information to see how efficiently ya ooerate in 
the ahi system. i hope the instructions are. sufficiently 
clear so ya will.^hav6 no difficulty inunderstandinc? what ya\ 
are to do. this exercise was r^exdcrted on 'the 
execupof tterminaL. There are ho correct* answers td any of 
the ouestions, but we do to want «?et yar^^eneral feelincfs-. 
try and wrok as raoidlv as is comfortable tc^v ya . if ya 
have time interruptions please not theyv (Continue to read 
the instructions, then come backhand- replace the fJashes with 
an X at the. aopropriate answer.) • 

I have been usin^ tjj^ ahi»system for months. 

- ' ■ - .• ^ ' ■ , . ' ■ . • ■ ■ 
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when i am \writinfi5 or ediliriR a rnanuscript i feel very^ 
comfortable witVi the ahi lanc?uac?'e. , . 



-■tstronely lagree --ac^ree --neutral --disatcree 
—strongly disat^r^e.. °, \ . 

why? ( , . 

V the ahi system is helpful in; myeveryday .worl?x ^ 

--strortAly a,t;ree — a^r«e — neutral — disa»^ree 
— stronely tJisaficree . • \ . - / 



tira^ started (?) 
time CyOm pie tQd (?) 
'GLEAN VERSION: 



We Would/like yvbu to do some specTfio thih«?sO*ith tlie 
followint? information to./se.e how efficiently you operate in 
the AHI system, t ho»De the instructions are sufficiently 
Clear ^o you will have no difficulty in understand int^ what 
ydti are- to do. 

: This exercise was j^enerated on an execuPQrt tertninal. 
There are no correct artswers to any of the Questions , but we 
do want to ^et your j^'eneral feelings. Try and work as 
Vapidly a§ is comfortable for you. If you have 
time-ihl^rruDtions plea^se note them. * 

Time started : C^) . * . ' 

I hsive bW usine: the ^HI system for (?) tnonths. 



When 'I ar^A^ editlnc; a mstnusclr*i-pt I fe^l verr 

confortabl^ wit^ AHI command language. • /< ^ 

i-:^stronf;ly ^cree >-^ai»ree --neutral ,-^-disac:ree 
--strdn^ly,^ disaccr\ee . ■ / \- / ■. ■ ■ / 

The' AHI systemV is helpful in my everyday work'. 



-.-strohtfly acrre<^ • — agree, — neutral — disagree 



H-strongly disa«rree 
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Time complied : (?) 



FURTHER 



CTIONS: 



Now' find out ^ho is oh the syst-em, link to either Bair.i 
Stone, Kehne,d.y or Mcnamara and aslc them for some relevant ~ 
nformation (time, when is next meetinf?, etc.). * " o . 




to Bair usinc»: the Journal 



, Now s^rid the comoleted 
ystem. 



Send a messac^e to Bair stating that yok have * finished 
th\e exercise and are sending him the complet^^d jTile .v.la_tJie- 
"Journal System. 



198^4. 



THAT'S IT!!!! YOU HAVE JUST. STRUCK ANOTHER BLOW FOR ^' 




ADDendix H 
Interview Procedures 



• Subjects' inipressions of tl|e AHI. System were obtained 
throu<yh. unstructured' interviewp i of. trained users. /The 
si-tuation iwas infor'Tial'' and intei^viewin«? took olace at each' 
subject 's desk. ' . 

The interviewer's introduction was brief. Subjects 
w^re told that their impressions of AHI were^t;oin^ to be 
recorded, a? would later impressions, in order *td help - 
establish* the effect of AHI. Subjects understood tljat, all 
new users of\ thre'AHI System were also to be inel-uderfxin this 
study/ V ; , 4 \ 

. .• A . .... 



ir any subjects had difficulty in resaon^in^, they^i^ere 
then prodded .with questions (see list^. The« tendency for 
^ most was to ^ive a positive or iiecratlv^short' response. - 

■ ■ '"' ' . ■ . 

Qi^estions Were not read to the subjects, but rather 
were presented in conversational form.. A minimjurm of 
.questions were^B^^^ in order to. prevent unduly st,ructurin^ 
the interview^. ^S<^n> questions were modified to suit the 
person, situation or conversation .\ >^qcasionaHy , questions 
needed to be reworded for a subject^ comprehension. 



All responses were accept.ed • ' No disaporoyal was. shown 
on the part of the interviewer / At times a' subject was . 
asked; to clarify his rest)onse. \ Most sub jects seemed at ease 
because they were acauainted with the - interv.iewer and the ^ \ 
studies* beincT done reiattin^e^ to^ AHI;*' * ^' / 

^. Questions' that were used: / ^ ^ * 

What' do you feel .are th^ ^ood and Bad poiats of AHI? 

■f' Do vou find the AHI System is efficient for -you to work . 
with? ' ^ .0 

■ ' ■ ^ *^ ' ([^^^^ — 

Was the training time on the Svst^m suffibient? 

Dq^4(au_feelfl^ou/Vet enoucrh ^practice on AHI? . 

Do you olan to use the AHI System for your work? 

Do you .like th^ 'Execuports? • \ ^ ^. 

Do. vou foresee any Drobleras in usin<;^ the System? 
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What is hard to learn/understand about AHI? 



Comment about the reliability of AHI.- 
. Comment about AHI's TNLS manuals 
Dp you use the* Send Messaee? 

\ 

kJles Send Messacre enabp.e. you to communic&te 
eff|ect\yely? 

Do\you ever lin^k with another usfer for cojnmunicat%on?' 

Dp W)u DP-efer the Send Messaeje to off-line inter-lDf fice 
memorandumis? / y\ ' , . 

Do^yoii^ writfe any letters with the AHl System? 

Does ^ th'^/Journal System help you -to work jtore 
efficiently? 

. . ■ \ , ' ' •,. ■ • ^ . ' . • ■ 

For what \type of work do you us^ the AHI- System? In 
What ways? . ^ \ * ' 

\ 



Do'^you prefer to do paper.work off line? l/hy? 
^Do you find >sharinC^^npthen_D0.r,gon,ys files V or 



useful? 



Do you like other peopte' beinc^ able^ t6 read yoyr files? 
Do you finc^ file sharing an asset of AHI? 



Would you' rather use pencil and pape> than the AHI - 
ster^ Why? For^what? V-^- ' ' V v 

^In yotir opinion what a^e si^cKie y^TFVhe best and wors^'^ 
features of. frhe AHI -System in relation/ to its efficiency, 
^ommands , and Viewsystem? / \ - . , ' ' * 

What do you feel ar6 some of the main problems of the 
AHI System? / \ • , . . ' , ^ ./ \ 

Under wrtat cond itions would you be inclined to^'use the 
AHI System more? V 

Would you irse» AI:iI more often if it were more reliable? 

If you had^ yoi^Ti/bwn terminal wouLd you use AHI more 
often? Would you want, your o'wn? 
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If you hal. be.tten command of the' System would^u use 
it 'ftore often? * " ^ 



Is the manual/trairu^g SDeoific* ertou^h? 

Do fou think thQ Journal System lacks, any necessary ■ 
features? * ' v ^ > 

' ^ Do vou'outline more when yoU use AHI to write a paper? 

Does it take you le^s time , to do your- work when you. use 
the AHI System for paperwork? y \ J \ 

^'^ ' ■ * ^ ■ 

Have you had much practice with AHI? 

How often do you use AHI? ReRularly? ' 

. Are^ystem's commands hard to retain after'^ a few weeks? 
Would a Veview 'sheet helD? 

Do yoa prefer any other computer System that you have 
been exposed to? " * ^ / 

' Are you familiar with any other 'subsystems of AHI - 
besides Send Message and Journal? ■ ,\ ^ , 
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Appendix I 



TRUCTIONS' FOR TUB COMMUKICATIOM TALLY SHEET 
• " ' - ' * 

lat is tallied? Yhc follov;ing interpersonal con t^K^t^ JteJainmHI^ipat ions) 
eixye to be tallied.* 

1) All telephone calls, \ 

2) All persona^I (face^to- face) gral coimnunication (formal or in- 
formal , cxcoDt for exchange of greetings), . 

3) All paper n^ittcr - letters, memos, requisitions, reports, ; . • 
pdriodicaln, instructions, etc.? each-batch from one source is 
considered as one contact regevrdle*^? of the number of pages* 

A) All communication events <except for meetings, and interactions 
on AHI) arc further isub-cUvided int,o three tivie classifications; 
less than 3 RTins., 3'to 15. mi ns * ,vand longer than 15 mins. These 
time divisions refer ^to the elapsed period of tim$? spent engaged 
in .the communipation event -^reaAiny, writing, speaking and/or 
listening* " V » - 

5) Formal meetings will be recorded inly by the person calling the 
" meeting, and the memo ysed.lK^ call' the (neeting can be forv.'ardcd 
**rather than having to rf!fcc>r^ett#i attendee on the tal"]feaf sheet, • ^. 
1$) dj^^ matter fs divided into tvr<Q^4tegories . One , concerns - 
fPI^Pr that is generally ^-iddre^sea and does not demaKd the 
attention of any particular xecipient . '^he other involves 
communications that are addressed/ Socially to the recipit*nt 
and require his attention. ■ ' ' » 



•^How is ithe, tallying done? , 

1) AftVr you have engaged in a phone call, a face-tb-f^ce ^ / 
^ : ftitoraction, or v;ith paner matter , fi.'rst recdrd th^ name 

orvnahcs of t^e other parties invplved On the loft-hvind 
* side of the tally sheet. If a person has already been ^ ^ ^ 
' listed on your tally si^ctife, you need not do so again, ^ypjii 
merely record the^sccond anrl third cor:imunicati6i^s oppp;sit;# 
))is name 'in the a::jpronriato column. . ""'^v- ' 

,2) Please identify the persons unambiguously so that he or sh^^ 
^ . cannot be coiifused with xinyone else. . . 

-3) To the right Vf the person's name with whom you -communicated, 
Search for the* appropriate cblumii according to the mode of 
conununicatlon/and" the 'elapsed time of tlie event,. . 

4) If you initi^ited the coniaunication, mark an "1" in the 

, ^ appropriate colunn. If yb\i rccoivcwi,. or at least "clid not 

X * ' ^ initiate the event, mark' an "R", .in the appropriate c/olur^n. 

Notii,. each comtnunic^tionN^vent should be recorded with 
eitjher an I or an R. li in, doubt about v;ho initiated the 
" . communicatiion, use your best, judgment, but please record it. 

5) If ; there are not^ enough rows on your tally sheet for a 
given day, please get another tally Sheet from your 

^ i^epresentative . ^ '* ' . , 

. . ,^ . . • / ; • ■ ^ ■ 

AB&ENCF/: If you are absent from your job either because of a > 
businei^s trip, illneiss, or hblidays, the fr-action of 
the day that you are <jorTe Cl/4y l/2,v3/4, 1) Should 
be recorded at the bottom^of th^ tally sheet. - 

t^emaining questions should be directed to the representative who^ 

. distributes and collects your tallV sheets each day, or • 
_^to Dr. Conratih or Capl;. Bair who can be reac*hed at ext*# 39?7 > 
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The. Limits of Ex^tf^rienUl Cofitrol ! Reor«;anization 

The population membershio was originally deterrnined^ by 
tlie organizational s'tructure at that time (over a year a?o). 
•it was not expected that thef e would be any ?na,1or chancses 
otHe^ than attrition and a few transfejrs. However, this has 
not been the case and this aooendix will deal with the 
exceptional events that occurred and-^the implication's . 
tliereof. ^ ^ .^^^''"'^ 

" Section 1% of the report deals T^ith the soeclf^l 
\.ttentlon c:iven to trhe nature of the^ population a^^ a whole, 
and the comparlaon oC-the control and exi)eriraental c;roups^. 
jIV <5reat deal of care was exercised to insure that • ^ 
differences based on organ Iza^tibnal stricture (especially* 
manaccer character istifcs) , demographic data , and th^* kind df 
jobs performed by tne respective groups were not 
^i<?nificaht/.or if they were, that this wsis clearly 
established for the data analysis- - The checks /that 'were 
made, inoli/dlhg .the OCX and- the Job Task- Type, showed that 
the oopulatibp was essentially/ homogeneous with a few \ 
^^xceptions such as slightly more programming in the controyl 
group i.ioft profile. ^ _ 

However, a reorganization' was directed by management 
.oximfetely six months_after the introductidh of the 
t^m to the user <?roup (approxiniately one- month before the 
posttest was given.) Ma^nagement was not changed, but a 
numbyer\of the subjects at the basic level were moved, wh|.le 
Vnew: individuals were brought In . Fortunately^; bnly one 
subject in the user group was moved : Several Individuals 
-^ere braugtrt inta the user organizational unit posing a 
ptroblem ex&imenta^y :>these sub jec^ 
. litdluded in the controllel auestionnaire ( "T" ) population.- 
Tlje subject who ciid l^ve Was given the posttest at his new 
l)0cation where Hlr^ Job had not substantially chartered. (The 
rtq»»^ content queartlonnaire was given to all users^ however, 
r including thbse jfiho were moved into the user group. This is 
noVoonfoundinff^bec^se the "Q" was a posttest only.) 

EicchtK members of\lie control group were, transferred to 
new loc?itid^ns within thVgame Divisian (see thre ' 
organizational landscape) and 3 departed entirely, An 
attrition level of three (ab.out ^5%) Is reasonable with the 
time ieriod of. several *months_i_jind is less than expected 
The loss lessened the significance of the statistical 

' ■ - ^ ; Vj' ■ 
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analysis, oarticularlv for th^ tests ; however, the 



analvsis was. still feasit)le; 



/ 



Compensation for the ^transferred 'subjects offered 
lit4:le oroblem. It simply involved c;iving them the posttest - ^ 
at tiheir new location. Little chahge was rfoted in the / 
' overall job ''situation . Since the chan<?e was late in the 
experimental period, even les3 brobab-ility of spurious 
effect exists for the c6htrolied portion of the study. Any 
effect would be in attitude' toward the orcranization , to 
which the "T" Questionnaire is not sensitive . *> ^ , 

Jhe^conjimunication tally analysis was not affected 
because of the nature of the .instrument The t?illy was don6 
after the reorc^aniz^tion^ witl# sufficient time for 
'communication oatterns t6 settle'. There were a large number 
of different subjects for this analysis than for trhe "T<'' * 
Questionnaire. Those sub jects who used AHI for 
cofiimunicat>tdn^ purpps.es were the ^arfie^ while 'The non-user ,. ^ 
portion df the population remained the j-nmedi^te . ♦ 

' vicini1;y. Thus ,^ Uie validity of the comparison between the • 
syst^ users and-' a^like cahtrol ^roup in* te^rms'^of ^ 

m^nicatio'n oatterns was unaffected by t^he reorcranizafeioh . 
Thfe only comparison affected would^e^h^t between the • 
cahtrol ccroup in the "T"' quest icyinaVe^ ajid the . edntrol group 

>r the. tally method' which \is not meaningful because the 
'crroup 'membership is substantially diss^imilar. The 
comparison , of concern is not affected — it involves thQ 
differences in communication patterns between; a 'group usinp: 
ohe system and' a like unit not using the system. . : 

It can be safely . concluded that for the purposes of 
thi3 study, no si^yhificant spurious effect resulted from the 
reorftani^ation . - . . ^ 
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